-- Logs begin at Wed 2022-08-24 10:27:33 UTC, end at Wed 2022-08-24 11:58:33 UTC. -- Aug 24 11:15:44.677156 dv-cinder-854273-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 11:15:44.686266 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 11:15:44.688000 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 11:15:44 2022] *** Aug 24 11:15:44.688000 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 11:15:44.688000 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 11:15:44.688000 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: nodename: dv-cinder-854273-2-iscsi Aug 24 11:15:44.688000 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: machine: x86_64 Aug 24 11:15:44.688000 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: clock source: unix Aug 24 11:15:44.688000 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: pcre jit disabled Aug 24 11:15:44.688000 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: detected number of CPU cores: 4 Aug 24 11:15:44.688000 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: current working directory: / Aug 24 11:15:44.688000 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: detected binary path: /usr/bin/uwsgi-core Aug 24 11:15:44.688708 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: your processes number limit is 47680 Aug 24 11:15:44.688708 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: your memory page size is 4096 bytes Aug 24 11:15:44.688708 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: detected max file descriptor number: 2048 Aug 24 11:15:44.688708 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: lock engine: pthread robust mutexes Aug 24 11:15:44.688708 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: thunder lock: enabled Aug 24 11:15:44.688708 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 11:15:44.688708 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 11:15:44.728000 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: Python main interpreter initialized at 0x55d1f17cf9c0 Aug 24 11:15:44.728000 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: python threads support enabled Aug 24 11:15:44.728000 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: your server socket listen backlog is limited to 100 connections Aug 24 11:15:44.728000 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: your mercy for graceful operations on workers is 90 seconds Aug 24 11:15:44.728489 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 11:15:44.728489 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: *** Operational MODE: preforking *** Aug 24 11:15:44.728684 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: *** uWSGI is running in multiple interpreter mode *** Aug 24 11:15:44.728684 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: spawned uWSGI master process (pid: 106187) Aug 24 11:15:44.728894 dv-cinder-854273-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 11:15:44.729540 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: spawned uWSGI worker 1 (pid: 106188, cores: 1) Aug 24 11:15:44.729943 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: spawned uWSGI worker 2 (pid: 106189, cores: 1) Aug 24 11:15:44.730046 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 11:15:45.396096 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 11:15:45.396687 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 11:15:46.499706 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:15:46.499706 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: from cryptography.utils import int_from_bytes Aug 24 11:15:46.500446 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:15:46.500446 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: from cryptography.utils import int_from_bytes Aug 24 11:15:46.500563 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:15:46.500563 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: from cryptography.utils import int_from_bytes Aug 24 11:15:46.500563 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:15:46.500563 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: from cryptography.utils import int_from_bytes Aug 24 11:15:48.988869 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:15:48.989468 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:15:48.989631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:15:48.990019 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:15:48.998432 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:15:48.998432 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:48.998725 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:15:48.999122 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:48.999228 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:15:48.999324 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:48.999428 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:15:48.999529 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:48.999619 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:15:48.999707 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:48.999793 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:15:48.999897 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:48.999897 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.000137 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.000226 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.000306 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.000422 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.000547 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.000640 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.000721 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.000798 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.000882 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.000962 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854273-2-iscsi {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.001048 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.001134 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.001218 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.001428 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.001556 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.001646 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.001738 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.001827 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.001922 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.002014 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.002100 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.002184 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.002272 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854273-2-iscsi {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.002351 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.002482 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.002482 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.002678 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.002791 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.002928 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.003018 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.003097 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.003229 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.003318 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.003409 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.003488 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.003573 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.003658 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.003658 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.003917 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.004023 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.004152 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.004252 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.004432 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.004530 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.004622 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.004809 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.004900 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.004900 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.005106 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854273-2-iscsi {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.005198 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.005282 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.005361 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.005493 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.005587 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.005682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.005785 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.005895 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.005979 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.006120 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.006120 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.006335 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854273-2-iscsi {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.006422 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.006521 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.006612 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.006692 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.006780 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.006859 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.006944 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.007024 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.007109 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.007196 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.007291 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.007373 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.007467 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.007549 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.007637 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.007716 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.007794 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.007880 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.007960 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.008254 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.008342 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.008478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.008563 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.008656 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.008745 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.008825 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.008951 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.009034 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.009120 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.009209 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.009297 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.009385 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.009619 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.009712 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.009803 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.009803 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.009982 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.009982 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.010143 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.010232 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.010321 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.010408 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.010497 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.010579 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.010645 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.010728 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.010816 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.010903 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.010984 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.011061 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.011138 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.011223 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.011302 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.011379 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.011462 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.011549 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.011716 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.011812 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.011892 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.011970 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.012056 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.012146 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.012238 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.012335 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.012495 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.012587 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.012667 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.012744 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.012830 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.012917 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.013047 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.013135 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.013227 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.013316 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.013481 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.013575 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.013656 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.013734 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.013810 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.013982 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.014139 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.014306 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.014497 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.014759 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.014852 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.015017 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.015116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.015329 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.015417 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.015670 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.015767 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.015991 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.016079 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.016300 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.016401 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.016608 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.016694 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.016859 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.016954 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.017158 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.017246 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.017461 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.017547 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.017824 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.017990 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.018109 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.018216 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.018415 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.018507 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.018721 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.018810 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.019019 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.019116 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.019323 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.019422 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.019724 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.019835 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.019961 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.020055 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.020283 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.020394 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.020530 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.020620 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.020825 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.020935 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.021123 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.021221 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.021424 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.021513 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.021725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.021849 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.022063 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.022177 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.022377 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.022466 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.022677 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.022763 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.023521 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.023616 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.023834 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.023972 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.024143 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.024280 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.024450 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.024599 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.024774 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.024906 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.025099 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.025213 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.025412 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.025532 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.025722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.025836 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.026061 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.026164 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.026371 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.026470 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.026692 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.026780 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.027005 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.027094 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.027317 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.027409 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.027626 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.027714 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.027929 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.028017 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.028236 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.028325 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.028538 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.028652 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.028841 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.028929 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.029140 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.029230 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.029440 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.029530 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.029740 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.029863 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.030065 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.030156 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.030366 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.030469 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.030666 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.030763 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.030962 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.031051 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.031264 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.031352 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.031572 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.031669 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.031876 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.031970 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.032181 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.032267 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.032480 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.032577 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.032784 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.032870 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.033086 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.033180 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.033407 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.033507 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.033734 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.033825 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.034075 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.034226 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.034389 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.034479 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.034699 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.034786 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.035020 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.035106 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:15:49.035333 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.035421 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.035648 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.035743 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.035971 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.036066 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.036280 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.036421 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.036589 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.036677 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.036897 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.037030 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.037213 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.037302 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.037530 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.037617 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.037857 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.037974 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.038192 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.038279 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.038520 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.039152 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.039369 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.039474 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.039677 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.039774 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.040026 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.040129 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.040324 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.040496 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.040658 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.040749 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.040990 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.041243 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.041393 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.041494 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.041577 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.041656 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.041925 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.042087 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.042237 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.042344 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.042570 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.042659 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.042970 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.043072 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.043190 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.043293 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.043499 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.043587 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.043818 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.043906 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.044149 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.044239 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.044461 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.044558 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.044779 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.044867 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.045092 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.045182 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.045405 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.045499 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.045711 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.045806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.046045 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.046144 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.046357 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.046446 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.046688 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.046775 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.047000 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.047085 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.047314 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.047415 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.047881 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.047993 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.048191 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.048280 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.048499 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.048585 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.048807 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.048908 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.049115 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.049203 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.049421 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.049522 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.049718 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.049817 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.050045 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.050136 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.050353 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.050443 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.050653 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.050751 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.050973 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.051060 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.051300 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.051389 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.051607 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.051704 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.051918 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.052005 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.052223 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.052321 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.052531 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.052627 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.052836 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.052923 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.053233 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.053451 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.053540 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.053760 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.053860 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.054092 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.054181 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.054433 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.054544 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.054752 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.054843 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.055059 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.055261 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.055364 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.055446 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.055661 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.055748 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.055962 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.056107 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.056263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.056344 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.056573 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.056662 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.056878 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.056979 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.057186 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.057269 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.057495 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.057590 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.057801 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.057941 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.058151 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.058283 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.058459 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.058558 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.058897 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.059001 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.059092 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.059179 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.059494 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.059586 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.059690 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.059793 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.060000 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.060130 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.060330 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.060525 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.060647 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.060849 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.060952 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.061185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.061314 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.061586 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.061685 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.061915 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.062008 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.062225 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.062319 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.062528 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.062618 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.062838 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.062934 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.063147 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.063242 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.063452 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.063541 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.063757 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.063849 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.064064 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.064150 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.064366 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.064555 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.064692 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.064835 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.064970 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.065103 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.065285 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.065426 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.065560 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.065651 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.065861 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.066011 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.066194 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.066289 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.066519 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.066629 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.066854 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.066958 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.067188 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.067288 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.067508 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.067729 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.067825 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.068125 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.068214 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.068442 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.068632 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.068749 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.069020 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.069121 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.069359 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.069505 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.069669 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.069909 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.070078 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.070242 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.070390 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.070573 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.070708 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.070901 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.071039 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.071217 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.071328 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.071539 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.071631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.071886 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.071985 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.072208 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.072297 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.072517 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.072603 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.072843 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.072938 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.073162 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.073250 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.073480 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.073575 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.073795 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.073905 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.074127 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.074230 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.074462 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.074609 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.074752 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.074846 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.075062 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.075157 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.075371 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.075460 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.075680 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.075769 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.075996 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.076192 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.076306 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.076396 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.076622 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.076712 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.076931 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.077019 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.077249 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.077341 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.077559 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.077657 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.077939 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.078030 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.078197 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.078282 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.078509 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.078599 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.078831 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.078917 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.079146 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.079293 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.079449 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.079537 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.079758 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.079848 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.080075 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.080172 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.080383 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.080471 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.080689 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.080776 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.080996 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.081094 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.081297 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.081393 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.081599 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.081699 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.081925 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.082030 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.082238 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.082326 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.082544 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.082638 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.082849 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.082939 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.083154 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.083243 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.083462 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.083550 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.083767 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.083862 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.084069 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.084157 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.084368 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.084455 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.084677 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.084765 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.084991 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.085077 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.085298 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.085927 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.086212 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.086303 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.086534 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.086628 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.086837 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.086935 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.087140 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.087229 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.087459 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.087545 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.087765 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.087861 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.088068 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.088155 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.088371 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.088458 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.088674 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.088843 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.089013 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.089254 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.089382 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.089585 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.089673 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.089922 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.090024 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.090237 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.090324 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.090541 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.090680 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.090857 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.090952 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.091163 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.091257 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.091468 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.091575 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.091782 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.091869 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.092089 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.092176 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.092391 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.092492 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.092699 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.092787 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.093005 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.093093 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.093333 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.093442 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.093625 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.093715 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.093967 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.094057 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.094272 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.094362 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.094579 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.094668 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.094885 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.094972 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.095185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.095274 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.095489 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.095588 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.096367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.096485 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.096582 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.096664 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.096751 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.096831 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.096903 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.096982 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.097567 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.097660 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.097737 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.097811 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.097933 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.098026 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.098108 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.098225 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.098314 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.098539 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.098627 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.098861 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.098950 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.099162 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.099437 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.099529 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.099756 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.099864 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.100056 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.100153 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.100360 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.100456 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.100661 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.100788 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.100962 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.101652 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.101820 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.101930 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.102160 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.102249 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.102462 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.102553 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.102768 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.102867 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.103069 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.103166 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.103368 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.103464 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.103697 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.103798 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.103990 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.104079 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.104299 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.104406 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.104601 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.104698 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.104914 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.105001 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.105219 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.105314 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.105524 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.105610 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.105823 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.105964 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.106175 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.106279 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.106454 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.106541 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.106773 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.106863 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.107084 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.107174 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.107401 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.107490 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.107712 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.107857 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.108026 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.108160 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.108328 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.108420 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.108637 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.108732 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.108936 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.109023 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.109237 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.109325 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.109536 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.109631 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.109842 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.109994 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.110170 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.110258 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.110470 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.110607 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.110780 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.110910 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.111086 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.111176 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.111393 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.111490 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.111697 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.111791 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.111996 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.112083 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.112301 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.112391 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.112601 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.112690 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.112911 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.112999 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.113219 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.113308 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.113525 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.113612 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.113821 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.113977 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.114150 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.114240 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.114454 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.114549 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.114752 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.114841 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.115058 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.115147 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.115359 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.115446 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.115673 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.115770 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.115971 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.116058 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.116270 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.116365 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.116568 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.116690 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.116900 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.116996 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.117205 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.117294 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.117506 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.117608 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.117810 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.117959 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.118145 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.118234 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.118447 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.118610 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.118747 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.118845 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.119051 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.119139 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.119350 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.119439 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.119652 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.119739 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.119955 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.120042 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.120272 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.120367 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.120580 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.120707 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.120877 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.121012 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.121181 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.121278 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.121482 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.121577 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.121783 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.121921 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.122108 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.122207 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.122410 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.122498 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.122708 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.122809 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.123007 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.123096 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.123306 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.123395 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.123610 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.123708 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.123908 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.123996 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.124218 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.124312 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.124520 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.124615 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.124819 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.124907 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.125119 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.125207 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.125418 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.125514 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.125719 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.125814 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.126051 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.126141 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.126360 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.126450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.126666 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.126755 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.126973 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.127061 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.127284 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.127385 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.127592 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.127679 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.127898 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.127985 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.128202 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.128298 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.128499 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.128587 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.128809 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.128897 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.129113 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.129202 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.129419 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.129508 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.129718 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.129860 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.130040 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.130128 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.130354 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.130444 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.130662 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.130759 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.130968 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.131094 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.131281 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.131370 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.131594 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.131691 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.131913 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.132000 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.132209 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.132322 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.132536 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.132637 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.132842 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.132939 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.133144 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.133234 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.133453 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.133551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.133754 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.133842 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.134085 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.134175 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.134395 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.134485 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.134700 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.134796 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.135008 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.135096 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.135321 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.135451 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.135618 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.135705 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.136125 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.136246 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.136350 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.136488 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.136586 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.136668 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.136816 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.136904 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.137119 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.137209 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.137418 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.137507 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.137721 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.137818 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.138044 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.138158 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.138352 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.138474 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.138651 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.138784 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.139081 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.139169 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.139390 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.139489 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.139695 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.139795 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.139992 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.140079 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.140298 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.140387 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.140605 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.140703 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.140981 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.141084 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.141220 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.141317 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.141515 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.141604 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.141825 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.141944 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.142246 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.142348 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.142548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.142642 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.142854 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.142944 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.143153 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.143250 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.143456 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.143552 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.143762 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.143849 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.144079 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.144173 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.144377 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.144465 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.144676 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.144771 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.144975 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.145095 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.145291 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.145412 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.145592 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.145728 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.145925 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.146143 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.146334 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.146453 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.146640 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.146762 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.146940 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.147111 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.147349 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.147439 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.147654 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.147742 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.148489 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.148599 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.148801 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.148889 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.149112 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.149209 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.149424 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.149512 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.149723 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.149809 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.150057 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.150178 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.150364 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.150498 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.150683 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.150808 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.151002 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.151225 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.151364 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.151539 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.151641 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.151853 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.151943 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.152178 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.152277 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.152499 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.152596 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.152808 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.152895 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.153121 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.153210 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.153439 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.153536 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.153751 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.153841 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.154106 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.154198 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.154435 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.154525 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.154752 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.154848 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.155061 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.155148 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.155363 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.155452 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.155669 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.155758 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.155973 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.156062 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.156278 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.156376 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.156600 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.156689 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.156902 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.157017 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.157209 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.157345 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.157516 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.157663 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.157820 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.158002 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.158146 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.158335 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.158447 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.158646 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.158766 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.158956 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.159067 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.159269 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.159387 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.159580 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.159697 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.159893 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.160020 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.160224 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.160340 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.160541 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.160630 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.160859 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.160958 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.161176 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.161264 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.161487 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.161584 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.161795 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.161939 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.162120 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.162208 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.162447 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.162547 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.162751 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.162847 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.163070 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.163159 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.163385 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.163481 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.164275 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.164384 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.164603 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.164706 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.164917 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.165016 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.165327 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.165432 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.165563 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.165730 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.165893 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.166075 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.166218 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.166402 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.166522 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.166783 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.166896 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.167178 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.167300 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.167516 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.167606 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.167827 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.167945 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.168138 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.168260 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.168445 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.169232 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.169360 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.169455 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.169539 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.169607 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.169672 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.169672 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.169817 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.169965 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.170116 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.170329 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.170461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.170578 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.170773 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.170916 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.171091 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.171290 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.171411 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.171600 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.171724 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.171917 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.172037 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.172269 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.172369 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.172837 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.172935 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.173169 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.173258 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.173590 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.173695 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.173788 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.173929 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.174133 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.174223 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.174440 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.174528 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.174828 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.174937 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.175073 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.175163 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.175486 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.175591 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.175711 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.175796 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.175992 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.176138 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.176298 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.176390 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.176610 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.176708 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.176922 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.177131 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.177268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.177372 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.177570 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.177796 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.177908 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.178226 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.178324 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.178545 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.178641 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.178857 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.179042 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.179215 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.179314 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.179543 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.179675 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.179872 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.180002 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.180175 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.180283 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.180488 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.180579 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.180800 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.180894 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.181111 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.181215 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.181444 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.181684 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.181834 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.182049 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.182140 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.182373 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.182473 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.182692 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.182790 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.183009 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.183107 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.183330 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.183430 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.183643 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.183747 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.183957 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.184056 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.184272 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.184365 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.184590 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.184749 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.184904 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.185022 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.185219 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.185327 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.185532 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.185646 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.185845 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.186025 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.186200 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.186302 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.186475 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.186574 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.186788 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.186889 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.187099 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.187194 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.187407 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.187497 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.187720 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.187850 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.188035 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.188130 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.188361 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.188700 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.188809 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.188942 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.189131 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.189260 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.189372 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.189465 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.189599 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.189697 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.189950 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.190105 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.190249 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.190636 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.190741 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.190824 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.190903 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.191150 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.191249 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.191472 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.191624 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.191792 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.191938 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.192107 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.192205 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.192423 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.192512 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.192774 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.192871 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.193125 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.193239 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.193354 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.193619 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.193717 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.193840 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.194068 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.194261 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.194484 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.194619 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.195283 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.195428 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.195589 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.195748 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.195904 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.196044 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.196197 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.196339 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.196499 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.196699 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.197035 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.197188 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.197327 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.197486 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.197628 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.197817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.198027 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.198173 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.198314 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.198485 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.198636 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.198776 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.198908 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.199078 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.199211 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.199402 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.199495 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.199747 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.199849 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.200069 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.200207 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.200354 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.200621 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.200871 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.200973 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.201058 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.201214 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.201305 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.201526 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.201623 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.201836 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.201950 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.202161 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.202255 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.202469 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.202559 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.202772 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.202861 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.203099 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.203189 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.203402 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.203491 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.203720 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.203817 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.204158 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.204264 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.204346 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.204435 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.204600 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.204704 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.204904 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.204993 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.205205 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.205294 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.205508 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.205606 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.205820 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.205931 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.206147 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.206236 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.206452 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.206555 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.206751 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.206844 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.207061 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.207157 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.207358 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.207454 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.207663 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.207753 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.207963 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.208050 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.208266 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.208404 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.208575 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.208675 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.208883 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.208974 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.209199 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.209297 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.209508 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.209597 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.209820 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.209958 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.210153 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.210252 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.211061 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.211203 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.211425 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.211516 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.211744 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.211881 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.212053 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.212356 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.212447 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.212834 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.212919 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.212999 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.213065 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.213319 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.213408 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.213636 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.213733 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.213969 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.214062 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.214276 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.214366 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.214581 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.214671 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.214910 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.215001 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.215220 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.215308 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.215529 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.215817 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.215917 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.216179 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.216267 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.216425 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.216609 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.216732 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.216822 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.217040 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.217138 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.217346 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.217436 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.217726 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.217839 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.217966 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.218051 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.218275 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.218404 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.218582 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.218671 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.218897 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.219088 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.219364 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.219450 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.219849 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.219971 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.220109 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.220226 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.220310 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.220437 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.220537 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.220749 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.220847 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.221063 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.221152 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.221380 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.221486 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.221677 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.221776 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.222012 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.222158 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.222322 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.222414 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.222632 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.222723 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.222952 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.223042 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.223262 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.223357 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.223565 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.223655 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.223919 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.224013 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.224236 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.224345 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.224559 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.224659 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.224872 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.225010 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.225188 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.225340 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.225489 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.225641 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.225787 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.225966 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.226137 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.226290 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.226440 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.226584 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.226736 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.226884 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.227062 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.227220 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.227400 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.227545 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.227725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.227873 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.228049 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.228198 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.228335 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.228465 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.228637 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.228785 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.228943 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.229090 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.229238 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.229394 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.229541 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.229740 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.230023 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.230145 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.230277 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.230392 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.230505 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.230630 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.230746 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.230897 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.231031 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.231239 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.231363 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.231570 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.231696 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.231872 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.232012 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.232212 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.232336 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.232491 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.232688 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.232811 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.232935 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.233060 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.233196 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.233339 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.233463 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.233590 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.233712 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.233913 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.234077 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.234211 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.234341 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.234472 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.234614 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.234789 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.234951 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.235082 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.235171 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.235372 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.235462 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.235674 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.235791 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.236009 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.236099 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.236338 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.236468 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.236640 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.236748 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.236948 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.237045 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.237254 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.237351 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.237560 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.237650 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.237862 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.237985 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.238198 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.238342 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.238503 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.238595 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.238809 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.238946 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.239111 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.239201 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.239411 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.239499 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.239734 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.239930 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.240066 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.240181 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.240334 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.240425 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.240640 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.240790 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.240949 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.241096 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.241252 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.241351 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.241578 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.241748 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.241965 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.242073 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.242279 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.242431 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.242609 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.242756 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.242917 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.243020 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.243232 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.243338 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.243543 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.243640 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.243853 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.243971 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.244163 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.244251 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.244473 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.244715 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.244818 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.244900 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.245080 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.245169 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.245387 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.245484 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.245695 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.245790 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.246031 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.246123 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.246345 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.246446 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.246655 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.246744 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.246969 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.247056 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.247283 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.247460 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.247597 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.247684 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.247913 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.247999 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.248222 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.248317 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.248536 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.248623 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.248850 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.248938 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.249166 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.249255 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.249479 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.249568 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.249799 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.249921 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.250140 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.250231 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.250447 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.250534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.250761 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.250848 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.251062 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.251152 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.251304 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:15:49.251402 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.251824 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.252028 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.252361 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.252688 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.253045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.253361 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.253708 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.254065 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.254385 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.254702 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.255012 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:15:49.255262 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:15:49.407259 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO dbcounter [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Registered counter for database nova_api Aug 24 11:15:49.411418 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO dbcounter [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] Registered counter for database nova_api Aug 24 11:15:49.429213 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_db.sqlalchemy.engines [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:15:49.431691 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG oslo_db.sqlalchemy.engines [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:15:49.436358 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG dbcounter [-] [106189] Writer thread running {{(pid=106189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:15:49.438670 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG dbcounter [-] [106188] Writer thread running {{(pid=106188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:15:49.496734 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.context [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),383ae89b-deb9-4b79-b0ab-3281c5f1e615(cell1) {{(pid=106189) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 11:15:49.496991 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.context [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),383ae89b-deb9-4b79-b0ab-3281c5f1e615(cell1) {{(pid=106188) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 11:15:49.500578 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:49.500887 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG oslo_concurrency.lockutils [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:49.501050 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:49.501374 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG oslo_concurrency.lockutils [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:49.502657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:49.503001 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG oslo_concurrency.lockutils [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:49.503406 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:49.503749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG oslo_concurrency.lockutils [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:15:49.503871 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:49.504209 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG oslo_concurrency.lockutils [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:15:49.505827 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:49.506231 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG oslo_concurrency.lockutils [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106188) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:15:49.508449 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO dbcounter [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Registered counter for database nova_cell0 Aug 24 11:15:49.508823 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO dbcounter [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] Registered counter for database nova_cell0 Aug 24 11:15:49.514584 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO dbcounter [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Registered counter for database nova_cell1 Aug 24 11:15:49.514838 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO dbcounter [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] Registered counter for database nova_cell1 Aug 24 11:15:49.522385 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_db.sqlalchemy.engines [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:15:49.525602 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG oslo_db.sqlalchemy.engines [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:15:49.527613 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_db.sqlalchemy.engines [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:15:49.529581 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG oslo_db.sqlalchemy.engines [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:15:49.533008 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG dbcounter [-] [106189] Writer thread running {{(pid=106189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:15:49.534420 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG dbcounter [-] [106188] Writer thread running {{(pid=106188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:15:49.534567 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG dbcounter [-] [106189] Writer thread running {{(pid=106189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:15:49.537909 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG dbcounter [-] [106188] Writer thread running {{(pid=106188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:15:49.683811 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO dbcounter [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Registered counter for database nova_cell0 Aug 24 11:15:49.684593 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO dbcounter [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] Registered counter for database nova_cell0 Aug 24 11:15:49.692235 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_db.sqlalchemy.engines [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:15:49.696721 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG oslo_db.sqlalchemy.engines [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:15:49.697849 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG dbcounter [-] [106189] Writer thread running {{(pid=106189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:15:49.701417 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG dbcounter [-] [106188] Writer thread running {{(pid=106188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:15:50.109598 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: WARNING keystonemiddleware.auth_token [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:15:50.116930 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: WARNING keystonemiddleware.auth_token [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:15:50.132102 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: WARNING keystonemiddleware.auth_token [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:15:50.139935 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: WARNING keystonemiddleware.auth_token [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:15:50.470872 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: WARNING keystonemiddleware.auth_token [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:15:50.476789 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: WARNING keystonemiddleware.auth_token [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:15:50.482047 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1f17cf9c0 pid: 106189 (default app) Aug 24 11:15:50.484155 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:15:50.485346 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] 10.222.0.83 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001771 Aug 24 11:15:50.485767 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 788 bytes} [Wed Aug 24 11:15:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:15:50.499861 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: WARNING keystonemiddleware.auth_token [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:15:50.505843 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: WARNING keystonemiddleware.auth_token [None req-5d713a4a-7824-46fe-b398-6c6b823eaf47 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:15:50.511689 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1f17cf9c0 pid: 106188 (default app) Aug 24 11:17:14.510531 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:14.511722 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 Aug 24 11:17:14.512229 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 2/2] 10.222.0.83 () {54 vars in 931 bytes} [Wed Aug 24 11:17:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:14.529020 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG dbcounter [-] [106188] Writing DB stats nova_api:SELECT=3 {{(pid=106188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:14.530082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG dbcounter [-] [106188] Writing DB stats nova_cell0:SELECT=3 {{(pid=106188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:14.531096 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG dbcounter [-] [106188] Writing DB stats nova_cell1:SELECT=3 {{(pid=106188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:14.532016 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG dbcounter [-] [106188] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:15.442750 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-f8d3e8b4-e3b9-436a-9104-ea035dd8eecf admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:15.476925 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-f8d3e8b4-e3b9-436a-9104-ea035dd8eecf admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.957673 Aug 24 11:17:15.477710 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 1/3] 10.222.0.83 () {60 vars in 1292 bytes} [Wed Aug 24 11:17:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:17.915571 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:17.917635 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-d6553fd9-b52d-4aba-b46c-2f7e244f440b None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002559 Aug 24 11:17:17.919972 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 3/4] 10.222.0.83 () {54 vars in 931 bytes} [Wed Aug 24 11:17:17 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:18.415083 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-eae0c348-c070-453f-9e18-b82397ea79b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "ram": 256, "swap": 0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:18.438520 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:17:18.438520 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: warnings.warn(msg) Aug 24 11:17:18.539590 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-eae0c348-c070-453f-9e18-b82397ea79b5 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.612752 Aug 24 11:17:18.540315 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 2/5] 10.222.0.83 () {64 vars in 1283 bytes} [Wed Aug 24 11:17:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:17:18.554942 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG dbcounter [-] [106189] Writing DB stats nova_api:SELECT=3 {{(pid=106189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:18.555871 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG dbcounter [-] [106189] Writing DB stats nova_cell1:SELECT=3 {{(pid=106189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:18.556679 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG dbcounter [-] [106189] Writing DB stats nova_cell0:SELECT=3 {{(pid=106189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:18.557560 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG dbcounter [-] [106189] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:18.778769 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-e6967147-541e-4b57-92af-627e3770e8a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:18.783466 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:17:18.783466 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: warnings.warn(msg) Aug 24 11:17:18.908662 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-e6967147-541e-4b57-92af-627e3770e8a8 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.359515 Aug 24 11:17:18.909256 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 4/6] 10.222.0.83 () {64 vars in 1336 bytes} [Wed Aug 24 11:17:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:21.303267 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-eae0c348-c070-453f-9e18-b82397ea79b5 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:21.304315 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-eae0c348-c070-453f-9e18-b82397ea79b5 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001697 Aug 24 11:17:21.304766 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 3/7] 10.222.0.83 () {54 vars in 931 bytes} [Wed Aug 24 11:17:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:17:21.993974 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-896a10ed-c90c-43e6-98a8-7f5fc97c8d95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:22.014807 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:17:22.014807 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: warnings.warn(msg) Aug 24 11:17:22.131577 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-896a10ed-c90c-43e6-98a8-7f5fc97c8d95 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.819519 Aug 24 11:17:22.133413 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 5/8] 10.222.0.83 () {64 vars in 1283 bytes} [Wed Aug 24 11:17:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:17:22.145426 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-bf5f9f64-50c7-4c70-abeb-a62895d3a0e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:22.148927 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:17:22.148927 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: warnings.warn(msg) Aug 24 11:17:22.260257 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-bf5f9f64-50c7-4c70-abeb-a62895d3a0e9 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118512 Aug 24 11:17:22.260863 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 4/9] 10.222.0.83 () {64 vars in 1336 bytes} [Wed Aug 24 11:17:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:17:24.701979 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-896a10ed-c90c-43e6-98a8-7f5fc97c8d95 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:24.702956 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-896a10ed-c90c-43e6-98a8-7f5fc97c8d95 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Aug 24 11:17:24.703382 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 6/10] 10.222.0.83 () {54 vars in 931 bytes} [Wed Aug 24 11:17:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:25.121448 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-3e94c01b-2137-4ef5-a9a9-f523d979a0e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:25.226048 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-3e94c01b-2137-4ef5-a9a9-f523d979a0e4 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.516459 Aug 24 11:17:25.226615 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 5/11] 10.222.0.83 () {64 vars in 1283 bytes} [Wed Aug 24 11:17:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:17:25.238675 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-9b46e711-0594-4be7-a440-bc4e99040c2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:25.333159 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-9b46e711-0594-4be7-a440-bc4e99040c2b admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098126 Aug 24 11:17:25.333786 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 7/12] 10.222.0.83 () {64 vars in 1336 bytes} [Wed Aug 24 11:17:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:27.741057 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-3e94c01b-2137-4ef5-a9a9-f523d979a0e4 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:27.742696 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-3e94c01b-2137-4ef5-a9a9-f523d979a0e4 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 24 11:17:27.743106 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 6/13] 10.222.0.83 () {54 vars in 931 bytes} [Wed Aug 24 11:17:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:28.262658 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-18f4816a-7881-4107-90e7-fcb27bd02a95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "disk": 10, "vcpus": 2, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:28.360822 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-18f4816a-7881-4107-90e7-fcb27bd02a95 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.610098 Aug 24 11:17:28.361593 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 8/14] 10.222.0.83 () {64 vars in 1283 bytes} [Wed Aug 24 11:17:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:17:28.376425 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-c1a040ef-38c1-4218-9703-f0e212390100 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:28.492216 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-c1a040ef-38c1-4218-9703-f0e212390100 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120959 Aug 24 11:17:28.493256 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 7/15] 10.222.0.83 () {64 vars in 1336 bytes} [Wed Aug 24 11:17:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:30.916687 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-18f4816a-7881-4107-90e7-fcb27bd02a95 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:30.917694 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-18f4816a-7881-4107-90e7-fcb27bd02a95 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 24 11:17:30.918128 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 9/16] 10.222.0.83 () {54 vars in 931 bytes} [Wed Aug 24 11:17:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:31.380382 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-48411744-04fb-424d-bd93-7f62dc546ba6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:31.506150 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-48411744-04fb-424d-bd93-7f62dc546ba6 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.581022 Aug 24 11:17:31.506920 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 8/17] 10.222.0.83 () {64 vars in 1283 bytes} [Wed Aug 24 11:17:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:17:31.519769 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-a39c1784-da1f-4dae-9ead-0fb3e8d4c09e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:31.647659 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-a39c1784-da1f-4dae-9ead-0fb3e8d4c09e admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131660 Aug 24 11:17:31.648407 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 10/18] 10.222.0.83 () {64 vars in 1336 bytes} [Wed Aug 24 11:17:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:34.134674 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-48411744-04fb-424d-bd93-7f62dc546ba6 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:34.136195 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-48411744-04fb-424d-bd93-7f62dc546ba6 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002290 Aug 24 11:17:34.136861 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 9/19] 10.222.0.83 () {54 vars in 931 bytes} [Wed Aug 24 11:17:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:34.637490 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-4e755080-87b1-4de3-9960-1420efe53ad8 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:34.662587 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-4e755080-87b1-4de3-9960-1420efe53ad8 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.516990 Aug 24 11:17:34.666094 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 11/20] 10.222.0.83 () {60 vars in 1292 bytes} [Wed Aug 24 11:17:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:17:37.078542 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-48411744-04fb-424d-bd93-7f62dc546ba6 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:37.079435 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-48411744-04fb-424d-bd93-7f62dc546ba6 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001687 Aug 24 11:17:37.079843 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 10/21] 10.222.0.83 () {54 vars in 931 bytes} [Wed Aug 24 11:17:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:37.592157 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-58b63f38-409f-4e6b-8dcb-8910740a5873 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "id": "1", "vcpus": 1, "disk": 1, "name": "m1.tiny"}} {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:37.670921 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-58b63f38-409f-4e6b-8dcb-8910740a5873 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.583663 Aug 24 11:17:37.672234 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 12/22] 10.222.0.83 () {64 vars in 1283 bytes} [Wed Aug 24 11:17:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:17:37.687040 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-38867425-f38c-4b6c-8c0c-70df6e07ef59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:37.785332 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-38867425-f38c-4b6c-8c0c-70df6e07ef59 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104242 Aug 24 11:17:37.785950 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 11/23] 10.222.0.83 () {64 vars in 1333 bytes} [Wed Aug 24 11:17:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:40.164071 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-58b63f38-409f-4e6b-8dcb-8910740a5873 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:40.165085 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-58b63f38-409f-4e6b-8dcb-8910740a5873 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 24 11:17:40.165714 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 13/24] 10.222.0.83 () {54 vars in 931 bytes} [Wed Aug 24 11:17:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:40.575350 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-3ba1daf1-2c73-4ef6-a303-ef6608a087bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:40.683292 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-3ba1daf1-2c73-4ef6-a303-ef6608a087bb admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.510479 Aug 24 11:17:40.683906 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 12/25] 10.222.0.83 () {64 vars in 1283 bytes} [Wed Aug 24 11:17:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:17:40.696810 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-bfbafb70-5a66-4e35-8b80-8a0bdea1c249 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:40.778665 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-bfbafb70-5a66-4e35-8b80-8a0bdea1c249 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086193 Aug 24 11:17:40.779333 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 14/26] 10.222.0.83 () {64 vars in 1333 bytes} [Wed Aug 24 11:17:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:43.163952 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-3ba1daf1-2c73-4ef6-a303-ef6608a087bb admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:43.169082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-3ba1daf1-2c73-4ef6-a303-ef6608a087bb admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001982 Aug 24 11:17:43.169082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 13/27] 10.222.0.83 () {54 vars in 931 bytes} [Wed Aug 24 11:17:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:43.666308 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-716ebcfc-8522-4040-95be-9b6a1fca9b06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "swap": 0, "disk": 40}} {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:43.837234 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-716ebcfc-8522-4040-95be-9b6a1fca9b06 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.665195 Aug 24 11:17:43.838199 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 15/28] 10.222.0.83 () {64 vars in 1283 bytes} [Wed Aug 24 11:17:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:17:43.851357 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-ce169b0e-4ca5-4188-96d1-536b74976038 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:43.973390 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-ce169b0e-4ca5-4188-96d1-536b74976038 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126701 Aug 24 11:17:43.974451 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 14/29] 10.222.0.83 () {64 vars in 1333 bytes} [Wed Aug 24 11:17:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:46.448343 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-716ebcfc-8522-4040-95be-9b6a1fca9b06 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:46.450229 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-716ebcfc-8522-4040-95be-9b6a1fca9b06 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Aug 24 11:17:46.450723 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 16/30] 10.222.0.83 () {54 vars in 931 bytes} [Wed Aug 24 11:17:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:46.901427 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-b8097543-37ca-43fc-91f7-20dd8002934a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "vcpus": 4, "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:46.907600 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG dbcounter [-] [106188] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:17:47.039657 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-b8097543-37ca-43fc-91f7-20dd8002934a admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.582222 Aug 24 11:17:47.040612 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 15/31] 10.222.0.83 () {64 vars in 1283 bytes} [Wed Aug 24 11:17:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:17:47.052790 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-3bceaa91-68db-4c43-88e5-025fa1cdc76b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:47.201328 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-3bceaa91-68db-4c43-88e5-025fa1cdc76b admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.152165 Aug 24 11:17:47.202717 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 17/32] 10.222.0.83 () {64 vars in 1333 bytes} [Wed Aug 24 11:17:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:17:49.812482 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-b8097543-37ca-43fc-91f7-20dd8002934a admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:17:49.813489 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-b8097543-37ca-43fc-91f7-20dd8002934a admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 24 11:17:49.814068 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 16/33] 10.222.0.83 () {54 vars in 931 bytes} [Wed Aug 24 11:17:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:17:50.308249 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-717f7d0e-58f9-44e8-9b3f-5ef549545c46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "id": "5"}} {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:50.414738 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-717f7d0e-58f9-44e8-9b3f-5ef549545c46 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.594259 Aug 24 11:17:50.415328 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 18/34] 10.222.0.83 () {64 vars in 1283 bytes} [Wed Aug 24 11:17:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:17:50.428959 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-0506467b-6fcb-4848-bee3-b92cb7c5deb6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:17:50.545111 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-0506467b-6fcb-4848-bee3-b92cb7c5deb6 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.121281 Aug 24 11:17:50.546340 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 17/35] 10.222.0.83 () {64 vars in 1333 bytes} [Wed Aug 24 11:17:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:18:10.225206 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-717f7d0e-58f9-44e8-9b3f-5ef549545c46 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:10.226247 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-717f7d0e-58f9-44e8-9b3f-5ef549545c46 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 24 11:18:10.226647 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 19/36] 10.222.0.83 () {54 vars in 931 bytes} [Wed Aug 24 11:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:10.646551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-c933b0e0-a31f-4854-9607-2be0f3012119 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:10.665243 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-c933b0e0-a31f-4854-9607-2be0f3012119 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.431896 Aug 24 11:18:10.665785 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 18/37] 10.222.0.83 () {60 vars in 1292 bytes} [Wed Aug 24 11:18:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:18:11.739305 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-717f7d0e-58f9-44e8-9b3f-5ef549545c46 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:11.740317 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-717f7d0e-58f9-44e8-9b3f-5ef549545c46 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 24 11:18:11.740721 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 20/38] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Aug 24 11:18:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:12.280191 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-3007e796-4a23-47ee-bb65-4c89f41d179e admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:12.286143 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.wsgi [None req-3007e796-4a23-47ee-bb65-4c89f41d179e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-3007e796-4a23-47ee-bb65-4c89f41d179e admin admin] Request method failure captured: Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Accept: application/json Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Accept-Encoding: gzip, deflate Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Connection: keep-alive Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Content-Length: 0 Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Host: 10.222.0.83 Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Openstack-Api-Version: compute 2.90 Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Openstack-System-Scope: None Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: User-Agent: python-novaclient Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Auth-Token: gAAAAABjBgjzW2mmbclKTfJw2Ia4ymST6KnMHS6jQ9bIjkLPR4vSPJ86YeRQQNaMVG-Hm6GPHW-Pm6CQmdDch8ToPrYcXDKvMn9Dos_vv9MkRqb_sgFC74bUDRO5EPUPho5hZs0GZXkNyOLHUCvQVSDI5I4m84pvcTTyq1fopJWlRLLrUHrP9_8 Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Domain-Id: None Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Domain-Name: None Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Identity-Status: Confirmed Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Is-Admin-Project: True Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Project-Domain-Id: default Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Project-Domain-Name: Default Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Project-Id: 17f9dd8b207b49df9eb8e79eece61c9b Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Project-Name: admin Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Role: member,admin,reader Aug 24 11:18:12.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Roles: member,admin,reader Aug 24 11:18:12.291004 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_17f9dd8b207b49df9eb8e79eece61c9b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:18:12.291004 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Tenant: admin Aug 24 11:18:12.291004 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Tenant-Id: 17f9dd8b207b49df9eb8e79eece61c9b Aug 24 11:18:12.291004 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Tenant-Name: admin Aug 24 11:18:12.291004 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User: admin Aug 24 11:18:12.291004 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User-Domain-Id: default Aug 24 11:18:12.291004 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User-Domain-Name: Default Aug 24 11:18:12.291004 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User-Id: 5d32a6d718b64e35aca00f733d966fd9 Aug 24 11:18:12.291004 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User-Name: admin Aug 24 11:18:12.291004 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: method: > Aug 24 11:18:12.291004 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: exception: Flavor 42 could not be found. Aug 24 11:18:12.291004 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: action_args: {'id': '42'} Aug 24 11:18:12.291004 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:12.291004 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:12.292082 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.293551 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-3007e796-4a23-47ee-bb65-4c89f41d179e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:12.294678 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-3007e796-4a23-47ee-bb65-4c89f41d179e admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.406338 Aug 24 11:18:12.294678 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 19/39] 10.222.0.83 () {60 vars in 1190 bytes} [Wed Aug 24 11:18:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:18:12.300868 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-7bf45e54-891f-4538-b449-81fb4fae5304 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:12.305075 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG dbcounter [-] [106189] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:18:12.324403 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-7bf45e54-891f-4538-b449-81fb4fae5304 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026433 Aug 24 11:18:12.324971 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 21/40] 10.222.0.83 () {60 vars in 1210 bytes} [Wed Aug 24 11:18:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:18:12.334844 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-a558fa5d-6bc9-44b4-8b6f-530502879fe0 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:12.358985 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-a558fa5d-6bc9-44b4-8b6f-530502879fe0 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027705 Aug 24 11:18:12.359541 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 20/41] 10.222.0.83 () {60 vars in 1210 bytes} [Wed Aug 24 11:18:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:18:12.369105 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-47db3e4c-0c4f-406b-ad85-34d77b3c3960 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:12.375647 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.wsgi [None req-47db3e4c-0c4f-406b-ad85-34d77b3c3960 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-47db3e4c-0c4f-406b-ad85-34d77b3c3960 admin admin] Request method failure captured: Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Accept: application/json Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Accept-Encoding: gzip, deflate Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Connection: keep-alive Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Content-Length: 0 Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Host: 10.222.0.83 Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Openstack-Api-Version: compute 2.90 Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Openstack-System-Scope: None Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: User-Agent: python-novaclient Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Auth-Token: gAAAAABjBgjzW2mmbclKTfJw2Ia4ymST6KnMHS6jQ9bIjkLPR4vSPJ86YeRQQNaMVG-Hm6GPHW-Pm6CQmdDch8ToPrYcXDKvMn9Dos_vv9MkRqb_sgFC74bUDRO5EPUPho5hZs0GZXkNyOLHUCvQVSDI5I4m84pvcTTyq1fopJWlRLLrUHrP9_8 Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Domain-Id: None Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Domain-Name: None Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Identity-Status: Confirmed Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Is-Admin-Project: True Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Project-Domain-Id: default Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Project-Domain-Name: Default Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Project-Id: 17f9dd8b207b49df9eb8e79eece61c9b Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Project-Name: admin Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Role: member,admin,reader Aug 24 11:18:12.378817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Roles: member,admin,reader Aug 24 11:18:12.385548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_17f9dd8b207b49df9eb8e79eece61c9b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:18:12.385548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Tenant: admin Aug 24 11:18:12.385548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Tenant-Id: 17f9dd8b207b49df9eb8e79eece61c9b Aug 24 11:18:12.385548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Tenant-Name: admin Aug 24 11:18:12.385548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User: admin Aug 24 11:18:12.385548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User-Domain-Id: default Aug 24 11:18:12.385548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User-Domain-Name: Default Aug 24 11:18:12.385548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User-Id: 5d32a6d718b64e35aca00f733d966fd9 Aug 24 11:18:12.385548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User-Name: admin Aug 24 11:18:12.385548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: method: > Aug 24 11:18:12.385548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: exception: Flavor 42 could not be found. Aug 24 11:18:12.385548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: action_args: {'id': '42'} Aug 24 11:18:12.385548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:12.385548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:12.387116 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:12.388450 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-47db3e4c-0c4f-406b-ad85-34d77b3c3960 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:12.389787 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-47db3e4c-0c4f-406b-ad85-34d77b3c3960 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014733 Aug 24 11:18:12.389787 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 22/42] 10.222.0.83 () {60 vars in 1190 bytes} [Wed Aug 24 11:18:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:18:13.371214 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-a558fa5d-6bc9-44b4-8b6f-530502879fe0 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:13.372269 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-a558fa5d-6bc9-44b4-8b6f-530502879fe0 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002206 Aug 24 11:18:13.372736 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 21/43] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Aug 24 11:18:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:13.924206 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-f7ba9f86-828b-4036-8ebe-50a2729b5246 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:13.929467 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.wsgi [None req-f7ba9f86-828b-4036-8ebe-50a2729b5246 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-f7ba9f86-828b-4036-8ebe-50a2729b5246 admin admin] Request method failure captured: Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Accept: application/json Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Accept-Encoding: gzip, deflate Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Connection: keep-alive Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Content-Length: 0 Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Host: 10.222.0.83 Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Openstack-Api-Version: compute 2.90 Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Openstack-System-Scope: None Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: User-Agent: python-novaclient Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Auth-Token: gAAAAABjBgj1EFx6-2nLvgc9hwUeKpDCVb2cpdl_DCyN7BnkS00045ecWbBxtfH0u1CHsfgbWIP2yDBSSSo-jQWzjz2melm4-zh2hD4SqAEi_WT0eXpAVoKKXt2wAuoqXU8brKp0CIH3QKd3BW45D9VyjXerXsOHQ-Mk2Sd-AwvLafkQW8a_eiE Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Domain-Id: None Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Domain-Name: None Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Identity-Status: Confirmed Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Is-Admin-Project: True Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Project-Domain-Id: default Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Project-Domain-Name: Default Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Project-Id: 17f9dd8b207b49df9eb8e79eece61c9b Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Project-Name: admin Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Role: member,admin,reader Aug 24 11:18:13.930987 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Roles: member,admin,reader Aug 24 11:18:13.932631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_17f9dd8b207b49df9eb8e79eece61c9b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:18:13.932631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Tenant: admin Aug 24 11:18:13.932631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Tenant-Id: 17f9dd8b207b49df9eb8e79eece61c9b Aug 24 11:18:13.932631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Tenant-Name: admin Aug 24 11:18:13.932631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User: admin Aug 24 11:18:13.932631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User-Domain-Id: default Aug 24 11:18:13.932631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User-Domain-Name: Default Aug 24 11:18:13.932631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User-Id: 5d32a6d718b64e35aca00f733d966fd9 Aug 24 11:18:13.932631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User-Name: admin Aug 24 11:18:13.932631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: method: > Aug 24 11:18:13.932631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: exception: Flavor 84 could not be found. Aug 24 11:18:13.932631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: action_args: {'id': '84'} Aug 24 11:18:13.932631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:13.932631 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:13.934268 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:13.935657 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-f7ba9f86-828b-4036-8ebe-50a2729b5246 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:13.936837 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-f7ba9f86-828b-4036-8ebe-50a2729b5246 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.423598 Aug 24 11:18:13.936837 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 23/44] 10.222.0.83 () {60 vars in 1190 bytes} [Wed Aug 24 11:18:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:18:13.942836 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-c8b711b1-a2d8-4bd2-8db6-43a8d4fa23c3 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:13.958279 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-c8b711b1-a2d8-4bd2-8db6-43a8d4fa23c3 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019008 Aug 24 11:18:13.958832 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 22/45] 10.222.0.83 () {60 vars in 1210 bytes} [Wed Aug 24 11:18:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:18:13.969186 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-77b5b717-20b4-4af4-8b0a-adeff029493c admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:13.984199 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-77b5b717-20b4-4af4-8b0a-adeff029493c admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018477 Aug 24 11:18:13.984755 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 24/46] 10.222.0.83 () {60 vars in 1210 bytes} [Wed Aug 24 11:18:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:18:13.994380 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-09924db4-5028-4b7b-a6fa-4a6d5ac2c9b8 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:13.999834 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.wsgi [None req-09924db4-5028-4b7b-a6fa-4a6d5ac2c9b8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-09924db4-5028-4b7b-a6fa-4a6d5ac2c9b8 admin admin] Request method failure captured: Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Accept: application/json Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Accept-Encoding: gzip, deflate Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Connection: keep-alive Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Content-Length: 0 Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Host: 10.222.0.83 Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Openstack-Api-Version: compute 2.90 Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Openstack-System-Scope: None Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: User-Agent: python-novaclient Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Auth-Token: gAAAAABjBgj1EFx6-2nLvgc9hwUeKpDCVb2cpdl_DCyN7BnkS00045ecWbBxtfH0u1CHsfgbWIP2yDBSSSo-jQWzjz2melm4-zh2hD4SqAEi_WT0eXpAVoKKXt2wAuoqXU8brKp0CIH3QKd3BW45D9VyjXerXsOHQ-Mk2Sd-AwvLafkQW8a_eiE Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Domain-Id: None Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Domain-Name: None Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Identity-Status: Confirmed Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Is-Admin-Project: True Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Project-Domain-Id: default Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Project-Domain-Name: Default Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Project-Id: 17f9dd8b207b49df9eb8e79eece61c9b Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Project-Name: admin Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Role: member,admin,reader Aug 24 11:18:14.001367 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Roles: member,admin,reader Aug 24 11:18:14.002806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_17f9dd8b207b49df9eb8e79eece61c9b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:18:14.002806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Tenant: admin Aug 24 11:18:14.002806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Tenant-Id: 17f9dd8b207b49df9eb8e79eece61c9b Aug 24 11:18:14.002806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Tenant-Name: admin Aug 24 11:18:14.002806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User: admin Aug 24 11:18:14.002806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User-Domain-Id: default Aug 24 11:18:14.002806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User-Domain-Name: Default Aug 24 11:18:14.002806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User-Id: 5d32a6d718b64e35aca00f733d966fd9 Aug 24 11:18:14.002806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User-Name: admin Aug 24 11:18:14.002806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: method: > Aug 24 11:18:14.002806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: exception: Flavor 84 could not be found. Aug 24 11:18:14.002806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: action_args: {'id': '84'} Aug 24 11:18:14.002806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:14.002806 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:14.003722 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:14.005007 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-09924db4-5028-4b7b-a6fa-4a6d5ac2c9b8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:14.006323 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-09924db4-5028-4b7b-a6fa-4a6d5ac2c9b8 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012066 Aug 24 11:18:14.006323 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 23/47] 10.222.0.83 () {60 vars in 1190 bytes} [Wed Aug 24 11:18:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 11:18:14.991803 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-77b5b717-20b4-4af4-8b0a-adeff029493c admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:14.992812 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-77b5b717-20b4-4af4-8b0a-adeff029493c admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 24 11:18:14.993213 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 25/48] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Aug 24 11:18:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:15.575099 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-7a35d8ea-4bcd-439b-b4e8-20acb30c1f7f admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:15.580938 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.wsgi [None req-7a35d8ea-4bcd-439b-b4e8-20acb30c1f7f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-7a35d8ea-4bcd-439b-b4e8-20acb30c1f7f admin admin] Request method failure captured: Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Accept: application/json Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Accept-Encoding: gzip, deflate Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Connection: keep-alive Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Content-Length: 0 Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Host: 10.222.0.83 Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Openstack-Api-Version: compute 2.90 Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Openstack-System-Scope: None Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: User-Agent: python-novaclient Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Auth-Token: gAAAAABjBgj2KUJQNML9LtoOriSOvzzhAdSWuwi-Fc2qTL9abxq8SSvi7kK3M0J3axRabTCcKTOisT9eZ0NWdtevHmaFng12DomqhzH4IxV1TvmKcnoD60xYhHaXiqhP4KuZ8454MhWn2j5EureKx6G14a045WQfdawLF0fhLXJqTZQkkPdi2GY Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Domain-Id: None Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Domain-Name: None Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Identity-Status: Confirmed Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Is-Admin-Project: True Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Project-Domain-Id: default Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Project-Domain-Name: Default Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Project-Id: 17f9dd8b207b49df9eb8e79eece61c9b Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Project-Name: admin Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Role: member,admin,reader Aug 24 11:18:15.583749 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Roles: member,admin,reader Aug 24 11:18:15.585478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_17f9dd8b207b49df9eb8e79eece61c9b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:18:15.585478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Tenant: admin Aug 24 11:18:15.585478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Tenant-Id: 17f9dd8b207b49df9eb8e79eece61c9b Aug 24 11:18:15.585478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-Tenant-Name: admin Aug 24 11:18:15.585478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User: admin Aug 24 11:18:15.585478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User-Domain-Id: default Aug 24 11:18:15.585478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User-Domain-Name: Default Aug 24 11:18:15.585478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User-Id: 5d32a6d718b64e35aca00f733d966fd9 Aug 24 11:18:15.585478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: X-User-Name: admin Aug 24 11:18:15.585478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: method: > Aug 24 11:18:15.585478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: exception: Flavor 451 could not be found. Aug 24 11:18:15.585478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: action_args: {'id': '451'} Aug 24 11:18:15.585478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:15.585478 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:15.586534 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: ERROR nova.api.openstack.wsgi Aug 24 11:18:15.588045 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-7a35d8ea-4bcd-439b-b4e8-20acb30c1f7f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106188) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:15.590303 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-7a35d8ea-4bcd-439b-b4e8-20acb30c1f7f admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.447772 Aug 24 11:18:15.590303 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 24/49] 10.222.0.83 () {60 vars in 1193 bytes} [Wed Aug 24 11:18:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:18:15.597142 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-7cd4f422-6852-4607-8445-6e46b3794ec1 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:15.612699 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-7cd4f422-6852-4607-8445-6e46b3794ec1 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021180 Aug 24 11:18:15.613260 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 26/50] 10.222.0.83 () {60 vars in 1210 bytes} [Wed Aug 24 11:18:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:18:15.624389 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-918072eb-70ab-450e-a4de-220d05f01428 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:15.640071 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-918072eb-70ab-450e-a4de-220d05f01428 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019750 Aug 24 11:18:15.640828 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 25/51] 10.222.0.83 () {60 vars in 1210 bytes} [Wed Aug 24 11:18:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:18:15.650348 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-f6078876-d1cb-4869-b8b5-bfaec9d3976d admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:15.656128 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.wsgi [None req-f6078876-d1cb-4869-b8b5-bfaec9d3976d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-f6078876-d1cb-4869-b8b5-bfaec9d3976d admin admin] Request method failure captured: Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Accept: application/json Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Accept-Encoding: gzip, deflate Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Connection: keep-alive Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Content-Length: 0 Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Host: 10.222.0.83 Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Openstack-Api-Version: compute 2.90 Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Openstack-System-Scope: None Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: User-Agent: python-novaclient Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Auth-Token: gAAAAABjBgj2KUJQNML9LtoOriSOvzzhAdSWuwi-Fc2qTL9abxq8SSvi7kK3M0J3axRabTCcKTOisT9eZ0NWdtevHmaFng12DomqhzH4IxV1TvmKcnoD60xYhHaXiqhP4KuZ8454MhWn2j5EureKx6G14a045WQfdawLF0fhLXJqTZQkkPdi2GY Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Domain-Id: None Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Domain-Name: None Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Identity-Status: Confirmed Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Is-Admin-Project: True Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Project-Domain-Id: default Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Project-Domain-Name: Default Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Project-Id: 17f9dd8b207b49df9eb8e79eece61c9b Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Project-Name: admin Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Role: member,admin,reader Aug 24 11:18:15.658725 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Roles: member,admin,reader Aug 24 11:18:15.660263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_17f9dd8b207b49df9eb8e79eece61c9b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/17f9dd8b207b49df9eb8e79eece61c9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:18:15.660263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Tenant: admin Aug 24 11:18:15.660263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Tenant-Id: 17f9dd8b207b49df9eb8e79eece61c9b Aug 24 11:18:15.660263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-Tenant-Name: admin Aug 24 11:18:15.660263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User: admin Aug 24 11:18:15.660263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User-Domain-Id: default Aug 24 11:18:15.660263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User-Domain-Name: Default Aug 24 11:18:15.660263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User-Id: 5d32a6d718b64e35aca00f733d966fd9 Aug 24 11:18:15.660263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: X-User-Name: admin Aug 24 11:18:15.660263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: method: > Aug 24 11:18:15.660263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: exception: Flavor 451 could not be found. Aug 24 11:18:15.660263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: action_args: {'id': '451'} Aug 24 11:18:15.660263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:18:15.660263 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:15.661185 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: ERROR nova.api.openstack.wsgi Aug 24 11:18:15.669682 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-f6078876-d1cb-4869-b8b5-bfaec9d3976d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106189) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:18:15.671290 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-f6078876-d1cb-4869-b8b5-bfaec9d3976d admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014143 Aug 24 11:18:15.671290 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 27/52] 10.222.0.83 () {60 vars in 1193 bytes} [Wed Aug 24 11:18:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 11:18:16.721158 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-918072eb-70ab-450e-a4de-220d05f01428 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:16.722250 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-918072eb-70ab-450e-a4de-220d05f01428 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 24 11:18:16.722651 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 26/53] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Aug 24 11:18:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:17.284137 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-8acc2ff6-fdb0-47c8-8ecd-d433b6dc031a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:18:17.351216 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-8acc2ff6-fdb0-47c8-8ecd-d433b6dc031a admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.487791 Aug 24 11:18:17.351745 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 28/54] 10.222.0.83 () {64 vars in 1235 bytes} [Wed Aug 24 11:18:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:18:18.366184 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-918072eb-70ab-450e-a4de-220d05f01428 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:18.367422 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-918072eb-70ab-450e-a4de-220d05f01428 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 24 11:18:18.367720 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 27/55] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Aug 24 11:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:18.903881 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-944f6ce4-a843-4855-ac16-5a44324a6226 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:18:18.990842 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-944f6ce4-a843-4855-ac16-5a44324a6226 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.479410 Aug 24 11:18:18.991386 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 29/56] 10.222.0.83 () {64 vars in 1235 bytes} [Wed Aug 24 11:18:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:18:20.018886 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-918072eb-70ab-450e-a4de-220d05f01428 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:20.019884 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-918072eb-70ab-450e-a4de-220d05f01428 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 24 11:18:20.020278 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 28/57] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Aug 24 11:18:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:20.567822 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-efd29dad-99e2-49eb-baf0-83513b50d207 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:18:20.649323 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-efd29dad-99e2-49eb-baf0-83513b50d207 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.490043 Aug 24 11:18:20.649826 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 30/58] 10.222.0.83 () {64 vars in 1235 bytes} [Wed Aug 24 11:18:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:18:21.640880 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-918072eb-70ab-450e-a4de-220d05f01428 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:21.640880 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-918072eb-70ab-450e-a4de-220d05f01428 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 24 11:18:21.640880 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 29/59] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Aug 24 11:18:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:22.167405 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-b97ae65e-571b-4131-87d6-640a0b7fa087 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:18:22.243110 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-b97ae65e-571b-4131-87d6-640a0b7fa087 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.471627 Aug 24 11:18:22.243589 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 31/60] 10.222.0.83 () {64 vars in 1235 bytes} [Wed Aug 24 11:18:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:18:23.221834 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-918072eb-70ab-450e-a4de-220d05f01428 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:23.222870 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-918072eb-70ab-450e-a4de-220d05f01428 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 24 11:18:23.223310 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 30/61] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Aug 24 11:18:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:18:23.762396 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-a088e068-49c2-4692-b14f-1fc8e88ccb23 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:18:23.783588 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-a088e068-49c2-4692-b14f-1fc8e88ccb23 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.423585 Aug 24 11:18:23.784145 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 32/62] 10.222.0.83 () {60 vars in 1202 bytes} [Wed Aug 24 11:18:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:19:18.313512 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-918072eb-70ab-450e-a4de-220d05f01428 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:18.314557 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-918072eb-70ab-450e-a4de-220d05f01428 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 24 11:19:18.315015 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 31/63] 10.222.0.83 () {54 vars in 931 bytes} [Wed Aug 24 11:19:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:19:18.326574 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG dbcounter [-] [106189] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:18.849954 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-1adcb918-5ec8-4c61-b5dc-69832d56b767 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:18.871548 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-1adcb918-5ec8-4c61-b5dc-69832d56b767 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.550508 Aug 24 11:19:18.872098 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 33/64] 10.222.0.83 () {60 vars in 1292 bytes} [Wed Aug 24 11:19:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:19:18.893661 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG dbcounter [-] [106188] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:19:18.897724 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-18b2ef98-dc7b-474e-b106-aab215bcd4a5 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:18.928418 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-18b2ef98-dc7b-474e-b106-aab215bcd4a5 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013720 Aug 24 11:19:18.928418 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 32/65] 10.222.0.83 () {60 vars in 1283 bytes} [Wed Aug 24 11:19:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:18.928752 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-bde7bed9-1054-48e5-a8dd-fe49764df81f admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:18.928752 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-bde7bed9-1054-48e5-a8dd-fe49764df81f admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013323 Aug 24 11:19:18.929126 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 34/66] 10.222.0.83 () {60 vars in 1286 bytes} [Wed Aug 24 11:19:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:19:18.941996 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-e2fba20b-7d36-429b-a3d7-c2b453242270 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:18.950167 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-e2fba20b-7d36-429b-a3d7-c2b453242270 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012002 Aug 24 11:19:18.950721 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 33/67] 10.222.0.83 () {60 vars in 1286 bytes} [Wed Aug 24 11:19:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:19:18.962878 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-2175c6bb-ae62-456a-baef-2482df1c0234 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:19:18.971718 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-2175c6bb-ae62-456a-baef-2482df1c0234 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012670 Aug 24 11:19:18.972270 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 35/68] 10.222.0.83 () {60 vars in 1283 bytes} [Wed Aug 24 11:19:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:22:40.364754 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-e2fba20b-7d36-429b-a3d7-c2b453242270 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:40.365772 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-e2fba20b-7d36-429b-a3d7-c2b453242270 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 24 11:22:40.366206 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 34/69] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Aug 24 11:22:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:22:40.508413 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG dbcounter [-] [106189] Writing DB stats nova_api:SELECT=6 {{(pid=106189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:40.682920 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-b1985b12-1828-4772-aa8a-cf590a70084b admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:40.690776 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:22:40.690776 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: warnings.warn(msg) Aug 24 11:22:40.690776 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-b1985b12-1828-4772-aa8a-cf590a70084b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:40.690776 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-b1985b12-1828-4772-aa8a-cf590a70084b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:40.690776 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-b1985b12-1828-4772-aa8a-cf590a70084b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:40.691628 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-b1985b12-1828-4772-aa8a-cf590a70084b admin admin] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:40.692144 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-b1985b12-1828-4772-aa8a-cf590a70084b admin admin] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:40.692651 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-b1985b12-1828-4772-aa8a-cf590a70084b admin admin] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:40.740371 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-b1985b12-1828-4772-aa8a-cf590a70084b admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.233455 Aug 24 11:22:40.740953 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 36/70] 10.222.0.83 () {60 vars in 1193 bytes} [Wed Aug 24 11:22:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:22:41.569257 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-e2fba20b-7d36-429b-a3d7-c2b453242270 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:41.570330 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-e2fba20b-7d36-429b-a3d7-c2b453242270 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 24 11:22:41.570728 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 35/71] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Aug 24 11:22:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:22:41.767357 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-1556dc7d-ace1-4af0-9336-074bdf065501 admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:41.769773 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:22:41.769773 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: warnings.warn(msg) Aug 24 11:22:41.771781 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-1556dc7d-ace1-4af0-9336-074bdf065501 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:41.772274 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-1556dc7d-ace1-4af0-9336-074bdf065501 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:41.772712 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-1556dc7d-ace1-4af0-9336-074bdf065501 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:41.773435 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-1556dc7d-ace1-4af0-9336-074bdf065501 admin admin] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:41.773983 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-1556dc7d-ace1-4af0-9336-074bdf065501 admin admin] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:41.774562 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-1556dc7d-ace1-4af0-9336-074bdf065501 admin admin] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:41.794251 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-1556dc7d-ace1-4af0-9336-074bdf065501 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083324 Aug 24 11:22:41.794817 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 37/72] 10.222.0.83 () {60 vars in 1193 bytes} [Wed Aug 24 11:22:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:22:53.060116 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-e2fba20b-7d36-429b-a3d7-c2b453242270 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:53.061120 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-e2fba20b-7d36-429b-a3d7-c2b453242270 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 24 11:22:53.061514 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 36/73] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Aug 24 11:22:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:22:53.207112 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG dbcounter [-] [106189] Writing DB stats nova_cell0:SELECT=4 {{(pid=106189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:53.208444 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG dbcounter [-] [106189] Writing DB stats nova_cell1:SELECT=4 {{(pid=106189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:53.209132 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG dbcounter [-] [106189] Writing DB stats nova_api:SELECT=8 {{(pid=106189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:22:53.259329 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-8d31ad3d-fa7a-4b57-bb36-c277be44f45c admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:53.262407 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:22:53.262407 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: warnings.warn(msg) Aug 24 11:22:53.263270 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-8d31ad3d-fa7a-4b57-bb36-c277be44f45c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:53.263894 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-8d31ad3d-fa7a-4b57-bb36-c277be44f45c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:53.264339 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-8d31ad3d-fa7a-4b57-bb36-c277be44f45c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:53.265315 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-8d31ad3d-fa7a-4b57-bb36-c277be44f45c admin admin] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:53.265789 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-8d31ad3d-fa7a-4b57-bb36-c277be44f45c admin admin] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:53.270663 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-8d31ad3d-fa7a-4b57-bb36-c277be44f45c admin admin] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:53.294696 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-8d31ad3d-fa7a-4b57-bb36-c277be44f45c admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.092617 Aug 24 11:22:53.295266 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 38/74] 10.222.0.83 () {60 vars in 1193 bytes} [Wed Aug 24 11:22:53 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:22:54.122051 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: DEBUG nova.api.openstack.wsgi [None req-e2fba20b-7d36-429b-a3d7-c2b453242270 admin admin] Calling method '>' {{(pid=106188) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:54.123068 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: INFO nova.api.openstack.requestlog [None req-e2fba20b-7d36-429b-a3d7-c2b453242270 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 11:22:54.123469 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: [pid: 106188|app: 0|req: 37/75] 10.222.0.83 () {56 vars in 1074 bytes} [Wed Aug 24 11:22:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:22:54.313719 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG nova.api.openstack.wsgi [None req-6d467fd0-5e93-478a-a603-f5860c9ade7a admin admin] Calling method '>' {{(pid=106189) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:22:54.316785 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 11:22:54.316785 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: warnings.warn(msg) Aug 24 11:22:54.317917 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-6d467fd0-5e93-478a-a603-f5860c9ade7a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:54.318579 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-6d467fd0-5e93-478a-a603-f5860c9ade7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:54.319017 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-6d467fd0-5e93-478a-a603-f5860c9ade7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:54.319739 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-6d467fd0-5e93-478a-a603-f5860c9ade7a admin admin] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:22:54.320183 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-6d467fd0-5e93-478a-a603-f5860c9ade7a admin admin] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:22:54.320607 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: DEBUG oslo_concurrency.lockutils [None req-6d467fd0-5e93-478a-a603-f5860c9ade7a admin admin] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106189) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:22:54.342660 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: INFO nova.api.openstack.requestlog [None req-6d467fd0-5e93-478a-a603-f5860c9ade7a admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081392 Aug 24 11:22:54.343159 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: [pid: 106189|app: 0|req: 39/76] 10.222.0.83 () {60 vars in 1193 bytes} [Wed Aug 24 11:22:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:23:56.783207 dv-cinder-854273-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 11:23:56.788705 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: Wed Aug 24 11:23:56 2022 - graceful shutdown triggered... Aug 24 11:23:56.789285 dv-cinder-854273-2-iscsi devstack@n-api.service[106188]: Gracefully killing worker 1 (pid: 106188)... Aug 24 11:23:56.789651 dv-cinder-854273-2-iscsi devstack@n-api.service[106189]: Gracefully killing worker 2 (pid: 106189)... Aug 24 11:23:57.784201 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: worker 1 buried after 1 seconds Aug 24 11:23:57.784201 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: worker 2 buried after 1 seconds Aug 24 11:23:57.784537 dv-cinder-854273-2-iscsi devstack@n-api.service[106187]: goodbye to uWSGI. Aug 24 11:23:57.785819 dv-cinder-854273-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 11:23:57.786396 dv-cinder-854273-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 11:23:57.789179 dv-cinder-854273-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 11:23:57.800080 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 11:23:57.802113 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 11:23:57 2022] *** Aug 24 11:23:57.802113 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 11:23:57.802113 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 11:23:57.802113 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: nodename: dv-cinder-854273-2-iscsi Aug 24 11:23:57.802113 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: machine: x86_64 Aug 24 11:23:57.802113 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: clock source: unix Aug 24 11:23:57.802113 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: pcre jit disabled Aug 24 11:23:57.802113 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: detected number of CPU cores: 4 Aug 24 11:23:57.802113 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: current working directory: / Aug 24 11:23:57.802113 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: detected binary path: /usr/bin/uwsgi-core Aug 24 11:23:57.802821 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: your processes number limit is 47680 Aug 24 11:23:57.802821 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: your memory page size is 4096 bytes Aug 24 11:23:57.802821 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: detected max file descriptor number: 2048 Aug 24 11:23:57.802821 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: lock engine: pthread robust mutexes Aug 24 11:23:57.802821 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: thunder lock: enabled Aug 24 11:23:57.802821 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 11:23:57.802821 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 11:23:57.841748 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: Python main interpreter initialized at 0x558ce254e9c0 Aug 24 11:23:57.841748 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: python threads support enabled Aug 24 11:23:57.841748 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: your server socket listen backlog is limited to 100 connections Aug 24 11:23:57.841748 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: your mercy for graceful operations on workers is 90 seconds Aug 24 11:23:57.843191 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 11:23:57.843191 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: *** Operational MODE: preforking *** Aug 24 11:23:57.843191 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: *** uWSGI is running in multiple interpreter mode *** Aug 24 11:23:57.843191 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: spawned uWSGI master process (pid: 121209) Aug 24 11:23:57.842803 dv-cinder-854273-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 11:23:57.845123 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: spawned uWSGI worker 1 (pid: 121221, cores: 1) Aug 24 11:23:57.845480 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: spawned uWSGI worker 2 (pid: 121222, cores: 1) Aug 24 11:23:57.845629 dv-cinder-854273-2-iscsi devstack@n-api.service[121209]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 11:23:58.511314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 11:23:58.517982 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 11:23:59.678382 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:23:59.678382 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: from cryptography.utils import int_from_bytes Aug 24 11:23:59.678977 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:23:59.678977 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: from cryptography.utils import int_from_bytes Aug 24 11:23:59.687612 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:23:59.687612 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: from cryptography.utils import int_from_bytes Aug 24 11:23:59.688093 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 11:23:59.688093 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: from cryptography.utils import int_from_bytes Aug 24 11:24:02.114362 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:24:02.114966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 11:24:02.114966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:24:02.115410 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 11:24:02.115499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:24:02.115576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 11:24:02.115657 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:24:02.115736 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 11:24:02.115805 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:24:02.115873 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 11:24:02.115953 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.116032 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.116101 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.116174 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.116249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.116317 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.116736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.116856 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.117042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.117145 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.117290 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.117388 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.117625 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.117723 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.117975 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.118108 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.118319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.118502 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.118587 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.118662 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.118914 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.119020 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.119232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854273-2-iscsi {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.119348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854273-2-iscsi {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.119559 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.119735 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.119890 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.120037 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.120192 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.120333 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.120474 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.120614 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.120776 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.120924 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.121079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.121249 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.121393 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.121543 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.121893 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.122108 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.122349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.122667 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.122987 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.123427 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.123638 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.123859 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.124078 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.126130 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.126390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.126390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.126844 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.127052 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.127275 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.127481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.127696 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.127927 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.128145 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.128358 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.128577 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854273-2-iscsi {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.128781 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.128994 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.129217 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.129431 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.129648 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854273-2-iscsi {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.129861 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.130133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.130355 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.130552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.130737 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.130894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.131043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.131223 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.131378 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.131521 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.131672 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.131816 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.132003 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.132157 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.132404 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.132553 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.132715 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.132872 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.133041 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.133367 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.133564 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.133718 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.133862 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.134078 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.134261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.134464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.134618 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.134768 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.134931 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.135080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.135229 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.135403 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.135562 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.135704 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.135851 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.136000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.136155 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.136305 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.136454 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.136605 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.136748 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.136909 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.137062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.137218 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.137367 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.137521 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.137669 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.137827 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.138029 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.138183 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.138332 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.138481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.138647 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.138803 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.138947 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.139096 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.139240 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.139391 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.139542 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.139691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.139833 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.139980 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.140123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.140265 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.140466 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.141130 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.141273 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.141422 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.141583 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.141726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.141920 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.142069 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.142220 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.142388 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.142616 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.142771 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.142925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.143086 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.143229 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.143388 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.143665 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.143825 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.143968 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.144116 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.144273 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.144425 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.144574 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.144726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.144868 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.145026 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.145169 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.145319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.145462 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.145616 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.145767 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.145972 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.146129 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.146279 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.146432 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.146582 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.146732 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.146882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.147034 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.147176 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.147324 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.147480 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.147629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.147770 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.147911 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.148051 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.148204 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.148346 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.148488 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.148638 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.148788 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.148938 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.149088 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.149230 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.149371 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.149512 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.149663 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.149812 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.149996 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.150146 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.150299 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.150448 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.150591 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.150738 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.150963 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.151107 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.151247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.151396 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.151545 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.151697 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.151697 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.151974 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.152127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.152276 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.152419 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.152589 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.152814 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.152982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.153137 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.153279 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.153442 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.153717 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.153955 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.154104 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.154252 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.154394 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.154536 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.154696 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.154840 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.154992 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.155142 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.155291 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.155433 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.155587 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.155730 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.155871 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.156019 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.156169 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.156319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.156473 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.156622 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.156771 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.156936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.157089 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.157240 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.157390 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.157532 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.157680 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.157833 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.158044 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.158205 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.158347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.158497 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.158646 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.158795 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.158947 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.159103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.159245 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.159386 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.159526 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.159674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.159822 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.159977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.160120 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.160261 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.160408 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.160549 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.160699 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.160857 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.160999 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.161141 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.161288 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.161430 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.161580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.161728 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.161907 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.162073 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.162228 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.162371 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.162525 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.162668 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.162840 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.163054 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.163201 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.163349 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.163510 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.163766 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 11:24:02.163925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.164077 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.164221 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.164372 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.164521 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.164663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.164823 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.164968 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.165167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.165330 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.165481 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.165625 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.165776 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.165993 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.166145 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.166549 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.166692 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.166834 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.166993 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.167143 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.167295 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.167445 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.167608 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.167757 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.167898 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.168046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.168201 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.168350 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.168508 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.168671 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.168820 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.168972 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.169114 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.169264 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.169407 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.169550 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.169702 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.169855 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.170040 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.170199 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.170342 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.170491 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.170641 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.170789 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.170940 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.171095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.171237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.171385 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.171527 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.171677 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.171826 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.171977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.172125 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.172276 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.172426 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.172578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.172743 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.172886 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.173045 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.173271 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.173271 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.173563 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.173721 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.174016 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.174169 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.174313 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.174462 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.174613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.174766 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.174926 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.174926 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.175323 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.175476 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.175627 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.175779 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.175924 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.176073 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.176225 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.176367 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.176588 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.176733 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.176884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.177047 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.177192 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.177192 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.177481 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.177624 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.177765 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.177971 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.178135 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.178279 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.178433 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.178584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.178734 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.178931 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.179089 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.179239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.179396 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.180438 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.180590 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.180744 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.180887 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.181032 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.181180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.181323 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.181497 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.181663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.181820 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.182017 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.182165 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.182307 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.182456 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.182614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.182766 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.182909 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.183059 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.183209 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.183519 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.183748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.184091 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.184272 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.184433 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.184582 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.184745 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.184895 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.185051 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.185208 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.185358 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.185507 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.185675 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.185825 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.186026 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.186189 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.186348 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.186505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.186667 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.186823 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.186972 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.187120 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.187776 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.187942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.188100 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.188250 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.188407 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.188557 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.188717 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.188881 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.189039 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.189188 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.189345 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.189503 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.189653 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.189810 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.190037 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.190202 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.190353 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.190510 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.190679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.190846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.190996 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.191152 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.191301 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.191449 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.191611 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.191760 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.191916 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.192073 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.192275 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.192436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.192828 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.192987 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.193125 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.193268 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.193428 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.193609 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.193767 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.194340 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.194505 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.194665 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.194815 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.194964 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.195155 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.195317 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.195468 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.195612 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.195748 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.195850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.195980 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.196122 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.196268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.196407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.196545 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.196698 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.196836 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.196974 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.197111 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.197260 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.197406 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.197556 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.197701 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.197841 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.198002 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.198143 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.198281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.198639 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.198639 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.198639 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.199045 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.199189 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.199189 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.199189 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.199612 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.199751 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.199751 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.200029 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.200180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.200318 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.200462 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.200599 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.200743 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.200890 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.201040 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.201194 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.201329 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.201467 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.201605 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.201750 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.202107 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.202251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.202385 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.202532 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.202671 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.202671 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.203549 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.203715 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.203855 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.203994 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.204180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.204344 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.204478 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.204566 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.204648 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.204730 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.204810 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.204901 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.204992 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.205075 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.205213 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.205350 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.205437 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.205533 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.205617 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.205698 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.205780 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.205861 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.205971 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.206068 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.206159 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.206241 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.206329 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.206412 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.206575 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.206661 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.206742 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.206829 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.206918 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.207008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.207008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.207008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.207256 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.207346 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.207428 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.207514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.207605 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.207687 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.207767 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.207855 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.207944 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.208026 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.208118 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.208201 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.208290 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.208373 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.208460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.208555 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.208644 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.208726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.208807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.208894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.208982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.209072 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.209162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.209244 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.209324 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.209411 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.209575 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.209675 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.209766 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.209849 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.209967 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.210051 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.210144 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.210237 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.210320 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.210402 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.210598 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.210699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.210914 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.211008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.211227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.211321 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.211549 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.211643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.211872 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.211965 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.212191 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.212289 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.212511 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.212600 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.212823 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.212913 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.213147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.213240 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.213460 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.213621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.213768 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.213925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.214109 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.214283 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.214417 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.214580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.214732 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.214936 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.215031 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.215271 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.215413 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.215604 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.215700 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.215938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.216030 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.216251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.216350 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.216566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.216659 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.216896 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.217030 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.217213 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.217306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.217526 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.217617 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.217840 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.217988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.218175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.218275 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.218523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.218617 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.218844 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.218935 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.219160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.219281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.219482 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.219591 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.219798 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.220012 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.220111 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.220390 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.220516 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.220719 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.220854 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.221035 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.221161 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.221355 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.221657 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.221792 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.221989 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.222119 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.222308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.222428 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.222632 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.222757 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.222965 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.223222 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.223354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.223565 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.223690 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.223931 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.224067 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.224260 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.224447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.224567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.224677 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.224867 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.225117 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.225366 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.225501 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.225622 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.225741 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.226149 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.226282 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.226450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.226576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.226698 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.226816 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.226941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.227060 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.227195 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.227375 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.227506 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.227638 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.227938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.228053 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.228247 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.228339 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.228562 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.228669 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.228871 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.228974 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.229182 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.229282 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.229498 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.229733 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.229905 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.230134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.230271 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.230484 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.230635 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.230790 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.230940 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.231092 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.231246 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.231383 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.231522 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.231660 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.231816 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.231961 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.232105 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.232245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.232462 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.232614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.232767 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.232911 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.233123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.233260 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.233518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.233653 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.233850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.234129 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.234376 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.234525 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.234667 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.234807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.234956 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.235109 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.235245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.235391 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.235538 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.235678 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.235816 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.235967 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.236125 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.236344 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.236489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.236638 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.236783 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.236948 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.237095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.237240 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.237387 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.237536 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.237688 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.237844 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.238019 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.238198 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.238334 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.238428 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.238524 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.238713 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.238806 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.239026 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.239118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.239340 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.239440 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.239662 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.239752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.239971 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.240070 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.240277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.240376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.240586 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.240683 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.240896 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.240986 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.241206 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.241376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.241513 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.241603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.241819 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.242001 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.242149 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.242244 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.242458 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.242557 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.242766 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.242858 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.243073 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.243173 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.243386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.243484 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.243696 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.243793 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.244002 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.244094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.244318 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.244409 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.244626 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.244714 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.244933 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.245014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.245241 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.245328 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.245552 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.245681 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.245859 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.245961 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.246188 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.246277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.246501 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.246603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.246821 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.246988 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.247130 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.247219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.247489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.247598 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.247779 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.247867 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.248130 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.248281 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.248440 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.248591 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.248727 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.248890 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.249029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.249175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.249328 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.249471 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.249615 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.250294 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.250434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.250578 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.250730 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.250870 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.251008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.251151 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.251301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.251438 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.251584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.251723 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.251860 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.252003 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.252142 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.252282 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.252438 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.252576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.252779 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.252920 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.253078 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.253227 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.253369 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.253506 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.253680 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.253820 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.254018 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.254163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.254333 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.254468 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.254626 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.254769 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.254911 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.255076 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.255334 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.255491 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.255633 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.255952 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.256269 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.256426 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.256661 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.256810 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.256960 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.257103 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.257254 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.257395 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.257550 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.257692 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.257842 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.258014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.258170 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.258367 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.258526 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.258671 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.259040 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.259358 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.259684 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.260152 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.261578 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.261578 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.262006 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.262167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.262328 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.262480 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.262480 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.262480 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.262480 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.263011 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.263163 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.263308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.263308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.263598 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.263759 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.263912 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.264063 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.264206 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.264355 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.264504 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.264655 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.264806 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.264958 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.265101 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.265247 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.265438 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.265587 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.265732 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.265888 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.266067 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.266201 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.266347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.266494 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.266670 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.266807 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.266902 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.267078 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.267180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.267421 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.267514 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.267740 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.267839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.268055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.268146 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.268374 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.268466 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.268689 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.268780 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.269001 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.269094 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.269315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.269406 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.269627 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.269759 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.269957 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.270115 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.270289 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.270436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.270610 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.270861 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.270955 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.271049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.271312 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.271462 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.271558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.271680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.271845 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.272002 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.272155 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.272314 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.272599 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.272745 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.272929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.273120 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.273241 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.273379 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.273552 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.273702 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.273956 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.274069 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.274213 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.274340 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.274536 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.274660 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.274857 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.274993 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.275241 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.275346 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.275590 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.275692 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.275905 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.276008 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.276217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.276310 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.276534 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.276632 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.276841 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.276936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.277151 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.277283 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.277469 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.277604 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.277798 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.277930 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.278138 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.278350 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.278450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.278671 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.278770 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.278989 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.279095 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.279319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.279410 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.279648 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.279740 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.279980 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.280071 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.280293 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.280449 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.281069 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.281205 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.281326 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.281541 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.281662 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.281805 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.282035 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.282182 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.282309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.282422 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.282542 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.282661 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.282781 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.282900 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.283012 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.283131 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.283251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.283363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.283480 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.283605 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.283812 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.283948 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.284217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.284335 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.284539 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.284659 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.284861 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.285005 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.285171 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.285317 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.285548 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.285680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.285808 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.285971 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.286137 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.286278 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.286458 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.286591 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.286773 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.286921 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.287089 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.287223 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.287422 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.287554 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.287734 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.287868 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.288053 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.288203 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.288374 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.288654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.288760 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.288980 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.289119 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.289289 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.289414 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.289646 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.289997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.290382 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.290525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.290695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.290822 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.291016 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.291146 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.291632 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.291766 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.291913 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.292041 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.292224 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.292379 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.292535 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.292663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.292865 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.292984 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.293178 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.293299 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.293501 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.293616 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.293816 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.293972 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.294159 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.294278 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.294514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.294641 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.294829 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.294956 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.295159 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.295286 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.295491 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.295723 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.295839 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.296040 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.296185 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.296317 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.296458 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.296585 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.297373 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.297527 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.297653 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.297754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.298048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.298241 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.298343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.298582 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.298675 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.298919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.299013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.299233 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.299331 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.299545 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.299637 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.299856 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.299954 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.300169 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.300270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.300488 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.300665 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.300795 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.301091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.301221 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.301400 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.301518 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.302255 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.302398 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.302398 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.302632 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.302736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.302822 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.302912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.302995 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.303083 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.303166 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.303262 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.303386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.303555 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.303696 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.303903 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.304009 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.304213 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.304306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.304554 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.304801 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.304894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.305186 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.305508 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.305636 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.305828 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.305969 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.306170 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.306495 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.306611 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.306822 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.307079 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.307184 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.307454 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.307592 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.307780 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.307885 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.308105 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.308209 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.308434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.308556 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.308755 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.308962 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.309292 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.309390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.309627 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.309728 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.309986 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.310094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.310311 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.310417 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.310635 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.310739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.310956 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.311064 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.311280 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.311372 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.311599 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.311691 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.311916 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.312008 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.312253 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.312995 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.313105 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.313191 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.313423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.313527 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.313749 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.313854 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.314105 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.314362 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.314457 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.314706 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.314805 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.315027 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.315128 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.315349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.315453 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.315667 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.315773 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.315989 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.316089 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.316311 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.316426 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.316631 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.316770 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.316948 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.317054 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.317265 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.317377 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.317582 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.317700 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.317933 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.318051 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.318246 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.318351 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.318567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.318672 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.318888 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.318991 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.319292 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.319405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.319507 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.319606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.319823 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.319925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322017 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322125 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322125 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322331 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322544 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322622 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322762 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322842 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322842 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.322982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.323106 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.323175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.323251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.323335 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.323406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.323475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.323543 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.323618 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.323837 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.323985 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.324164 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.324296 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.324479 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.324609 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.324807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.324954 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.325113 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.325273 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.325415 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.325551 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.325719 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.325861 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.326082 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.326211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.326371 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.327185 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.327279 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.327279 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.327468 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.327552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.327634 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.327813 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.327926 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.328011 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.328107 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.328282 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.328536 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.328661 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.328891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.329004 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.329213 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.329329 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.329534 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.329637 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.329847 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.329971 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.330187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.330305 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.330499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.330606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.330809 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.330911 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.331127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.331251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.331438 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.331575 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.331761 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.331890 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.332079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.332216 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.332390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.332533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.332701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.333016 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.333156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.333331 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.333513 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.333641 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.333929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.334031 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.334277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.334382 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.334613 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.334747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.334952 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.335282 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.335614 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.335789 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.335941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.336101 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.336271 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.336428 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.336588 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.336783 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.336936 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.337085 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.337241 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.337390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.337553 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.337710 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.337858 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.338065 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.338223 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.338383 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.338546 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.338720 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.338870 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.339025 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.339182 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.339325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.339594 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.339813 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.340131 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.340355 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.340509 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.340690 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.340841 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.341018 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.341180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.341343 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.341453 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.341676 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.341774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.342028 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.342310 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.342480 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.342631 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.342794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.342946 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.343217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.343343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.343444 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.343563 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.343662 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.343756 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.343993 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.344300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.344400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.344628 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.344734 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.344942 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.345043 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.345264 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.345358 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.345579 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.345675 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.345920 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.346027 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.346234 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.346326 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.346545 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.346648 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.346874 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.346972 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.347190 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.347286 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.347505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.347605 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.347824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.347917 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.348139 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.348232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.348455 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.348556 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.348770 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.348863 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.349092 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.349360 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.349539 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.349944 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.350104 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.350255 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.350400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.350559 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.350701 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.350805 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.350942 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.351104 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.351247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.351401 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.351545 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.351698 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.351840 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.351992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.352145 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.352287 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.352427 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.352523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.352609 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.352807 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.352912 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.353132 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.353226 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.353448 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.353549 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.353763 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.353913 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.354105 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.354202 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.354420 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.354521 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.354742 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.354844 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.355058 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.355153 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.355375 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.355470 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.355684 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.355778 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.355998 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.356120 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.356314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.356444 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.356638 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.356772 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.356986 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.357104 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.357318 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.357425 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.357644 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.357740 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.357992 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.358104 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.358319 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.358488 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.358639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.358747 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.358956 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.359052 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.360010 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.360140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.360239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.360333 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.360432 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.360519 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.360759 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.360873 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.361080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.361226 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.361393 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.361497 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.361712 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.361827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.362054 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.362273 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.362378 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.362527 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.362680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.362888 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.362995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.363220 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.363324 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.363582 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.363726 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.363894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.364026 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.364204 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.364334 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.364686 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.364973 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.365317 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.365487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.365641 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.365787 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.365993 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.366157 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.366307 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.366462 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.366624 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.366772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.366934 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.367082 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.367229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.367375 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.367522 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.367680 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.367836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.367942 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.368193 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.368504 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.368817 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.369130 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.369439 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.369747 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.370324 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.370446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.370771 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.371102 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.371426 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.371755 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.372072 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.372402 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.372731 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.373057 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.373373 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.373713 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.374051 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.374277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.374422 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.374636 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.374808 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.375525 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.375663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.375849 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.375980 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.376165 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.376297 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.376499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.376623 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.376824 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.376960 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.377133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.377254 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.377459 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.377588 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.377778 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.377934 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.378130 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.378250 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.378446 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.378567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.378761 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.378883 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.379095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.379330 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.379469 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.379719 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.379863 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.380035 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.380416 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.380656 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.380799 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.380978 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.381208 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.381354 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.381596 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.381829 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.382138 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.382721 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.382871 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.383005 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.383137 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.383137 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.383457 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.383606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.383606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.383871 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.384006 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.384170 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.384310 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.384489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.384697 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.384833 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.385153 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.385299 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.385472 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.385665 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.385802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.386133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.386277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.386419 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:24:02.386627 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.387028 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.387431 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.387828 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.388215 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.388625 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.389015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.389406 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.389809 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.390558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.390995 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.391386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.391890 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.392294 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.392710 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.393210 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.393605 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.394102 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.394501 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.394892 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.395314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.395802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.396192 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.396580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.397956 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.397956 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.397956 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.398363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.398701 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.399094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.399486 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.399889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.400451 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.400878 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.401281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.401716 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.402163 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.404533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.404533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.404533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.404533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.404533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.404533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 11:24:02.404533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 11:24:02.449068 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO dbcounter [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] Registered counter for database nova_api Aug 24 11:24:02.469141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO dbcounter [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] Registered counter for database nova_api Aug 24 11:24:02.470032 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_db.sqlalchemy.engines [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:24:02.477242 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writer thread running {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:24:02.491579 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_db.sqlalchemy.engines [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:24:02.498751 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writer thread running {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:24:02.534653 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.context [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),383ae89b-deb9-4b79-b0ab-3281c5f1e615(cell1) {{(pid=121221) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 11:24:02.538775 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:02.539259 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:02.540847 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:02.541970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:02.542347 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:02.544337 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:02.546371 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO dbcounter [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] Registered counter for database nova_cell0 Aug 24 11:24:02.551146 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO dbcounter [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] Registered counter for database nova_cell1 Aug 24 11:24:02.557903 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.context [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),383ae89b-deb9-4b79-b0ab-3281c5f1e615(cell1) {{(pid=121222) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 11:24:02.560665 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:02.561150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:02.561436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_db.sqlalchemy.engines [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:24:02.562868 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_db.sqlalchemy.engines [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:24:02.563384 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:02.564194 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:02.564922 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:02.567324 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:02.568834 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writer thread running {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:24:02.569411 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO dbcounter [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] Registered counter for database nova_cell0 Aug 24 11:24:02.573715 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO dbcounter [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] Registered counter for database nova_cell1 Aug 24 11:24:02.581613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_db.sqlalchemy.engines [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:24:02.585547 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_db.sqlalchemy.engines [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:24:02.588106 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writer thread running {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:24:02.717171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writer thread running {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:24:02.719972 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO dbcounter [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] Registered counter for database nova_cell0 Aug 24 11:24:02.726993 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_db.sqlalchemy.engines [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:24:02.729119 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writer thread running {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:24:02.731628 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writer thread running {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:24:02.739954 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO dbcounter [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] Registered counter for database nova_cell0 Aug 24 11:24:02.746952 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_db.sqlalchemy.engines [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 11:24:02.751769 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writer thread running {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 11:24:03.071151 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: WARNING keystonemiddleware.auth_token [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:24:03.073378 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: WARNING keystonemiddleware.auth_token [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:24:03.079054 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: WARNING keystonemiddleware.auth_token [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:24:03.081182 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: WARNING keystonemiddleware.auth_token [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:24:03.424012 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: WARNING keystonemiddleware.auth_token [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:24:03.426529 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: WARNING keystonemiddleware.auth_token [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 11:24:03.430160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: WARNING keystonemiddleware.auth_token [None req-0ff72af7-b893-4198-b9d3-4fae9f54e887 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:24:03.432625 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: WARNING keystonemiddleware.auth_token [None req-58dd71bb-a392-431d-925b-40307bdcf8f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 11:24:03.435561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558ce254e9c0 pid: 121221 (default app) Aug 24 11:24:03.438017 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558ce254e9c0 pid: 121222 (default app) Aug 24 11:24:38.248193 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:38.249522 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:38.250450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:38.251456 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:39.710811 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-de58cd3d-d052-469e-89af-5a66ce831089 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Action: 'create', calling method: .version_select at 0x7f723f7c25e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-552793514", "metadata": {"Type": "work"}}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:40.871546 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:40.873717 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:40.875274 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:40.876569 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:24:41.688956 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d1d1a560-0a1c-4b4e-b4a2-affe1ef80db2 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Action: 'create', calling method: .version_select at 0x7f723f7c3700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2124724848"}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:42.267084 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-de58cd3d-d052-469e-89af-5a66ce831089 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.038628 Aug 24 11:24:42.276724 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 1/1] 10.222.0.83 () {60 vars in 1156 bytes} [Wed Aug 24 11:24:38 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4041 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 11:24:42.285193 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6ed89eac-f4ca-40f4-9f8e-ad11d680873c tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723f6964c0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:42.911158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6ed89eac-f4ca-40f4-9f8e-ad11d680873c tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 352 microversion: 2.1 time: 0.455052 Aug 24 11:24:42.911158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 2/2] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:42 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 352 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:43.584077 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d1d1a560-0a1c-4b4e-b4a2-affe1ef80db2 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.721881 Aug 24 11:24:43.585818 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 1/3] 10.222.0.83 () {60 vars in 1155 bytes} [Wed Aug 24 11:24:40 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2725 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 24 11:24:43.602044 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5b2629f3-ad31-49b5-9dd8-0204858298cd tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723f696b80>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:43.719435 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5b2629f3-ad31-49b5-9dd8-0204858298cd tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b" status: 200 len: 345 microversion: 2.1 time: 0.121108 Aug 24 11:24:43.720001 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 3/4] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:43 2022] GET /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:24:43.749153 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f3fb4a04-99e6-42fc-92e0-1d6b7f158ee4 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723f698550>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:43.885262 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f3fb4a04-99e6-42fc-92e0-1d6b7f158ee4 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 352 microversion: 2.1 time: 0.140269 Aug 24 11:24:43.886114 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 2/5] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:43 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:44.560948 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e87299c6-3193-49c1-a483-2fa68cf8a11a tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] Calling method '.version_select at 0x7f723f6ad3a0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:44.675052 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e87299c6-3193-49c1-a483-2fa68cf8a11a tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/619ab0f4-0203-4d75-9fad-410415aca0d1" status: 200 len: 351 microversion: 2.1 time: 0.126947 Aug 24 11:24:44.675976 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 4/6] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:44 2022] GET /compute/v2.1/os-volumes/619ab0f4-0203-4d75-9fad-410415aca0d1 => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:44.733537 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0a9daeae-1236-4476-8e00-f08861d98719 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723f698ca0>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:44.902236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-41bba56c-58af-446b-9150-578e7bdb8d1c tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723f696af0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:45.205549 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0a9daeae-1236-4476-8e00-f08861d98719 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b" status: 200 len: 346 microversion: 2.1 time: 0.476270 Aug 24 11:24:45.214128 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 3/7] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:44 2022] GET /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b => generated 346 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:45.228225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6f84e049-9257-4fa5-8f61-f55d3000ce68 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Action: 'create', calling method: .version_select at 0x7f723f6aa310>, body: {"snapshot": {"volume_id": "f1f3a1a1-fe81-4980-8fa1-e673b12a152b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-31762091"}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:45.362921 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-41bba56c-58af-446b-9150-578e7bdb8d1c tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 353 microversion: 2.1 time: 0.465658 Aug 24 11:24:45.363744 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 5/8] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:44 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 353 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:24:45.386707 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b217aca0-5908-48c8-9137-b4fc9e4a4fa2 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723f696430>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:46.444153 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b217aca0-5908-48c8-9137-b4fc9e4a4fa2 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 353 microversion: 2.1 time: 1.053936 Aug 24 11:24:46.444153 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 6/9] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:45 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 353 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:46.456556 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6ac12c50-2067-4c66-a56f-1eaef21461ce tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723f6ad430>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:46.862087 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6f84e049-9257-4fa5-8f61-f55d3000ce68 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 1.646605 Aug 24 11:24:46.863327 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 4/10] 10.222.0.83 () {60 vars in 1162 bytes} [Wed Aug 24 11:24:45 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:46.882308 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1e37aa5f-6952-46ff-bb7a-8017b96f6b04 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723f6aab80>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:46.973386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1e37aa5f-6952-46ff-bb7a-8017b96f6b04 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 200 len: 285 microversion: 2.1 time: 0.099307 Aug 24 11:24:46.981938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 5/11] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:24:46 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:46.990320 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-168723fe-46fa-49e0-a99a-75b078c6f9fb tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723f6aa430>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:47.057735 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6ac12c50-2067-4c66-a56f-1eaef21461ce tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 202 len: 0 microversion: 2.1 time: 0.606391 Aug 24 11:24:47.058542 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 7/12] 10.222.0.83 () {58 vars in 1248 bytes} [Wed Aug 24 11:24:46 2022] DELETE /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:24:47.066991 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-10df14a7-cabf-4d92-b723-c2a91886fc5d tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723f6963a0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:47.117838 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-168723fe-46fa-49e0-a99a-75b078c6f9fb tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.134234 Aug 24 11:24:47.125813 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 6/13] 10.222.0.83 () {58 vars in 1140 bytes} [Wed Aug 24 11:24:46 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:47.131056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-dfce65e3-0a82-4562-a320-4a4d8ca59bbe tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723f7c3820>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:47.188562 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-dfce65e3-0a82-4562-a320-4a4d8ca59bbe tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 200 len: 285 microversion: 2.1 time: 0.061474 Aug 24 11:24:47.189317 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 7/14] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:24:47 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 285 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:47.207570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-10df14a7-cabf-4d92-b723-c2a91886fc5d tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 352 microversion: 2.1 time: 0.144833 Aug 24 11:24:47.208223 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 8/15] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:47 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 352 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:24:47.615377 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a9967fd6-fb6b-4aed-b3b1-d92deb1b643e tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] Calling method '.version_select at 0x7f723f6984c0>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:47.707023 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a9967fd6-fb6b-4aed-b3b1-d92deb1b643e tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/caf59912-99f0-49a9-b05b-bf847571e780" status: 200 len: 351 microversion: 2.1 time: 0.095961 Aug 24 11:24:47.708105 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 8/16] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:47 2022] GET /compute/v2.1/os-volumes/caf59912-99f0-49a9-b05b-bf847571e780 => generated 351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:48.200953 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9ec61af8-de09-436a-a4ce-014db662b98a tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723f696a60>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:48.220874 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-40a526d1-717f-4e6b-80a3-553041089c9a tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723f698b80>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:48.281612 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9ec61af8-de09-436a-a4ce-014db662b98a tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 200 len: 285 microversion: 2.1 time: 0.078931 Aug 24 11:24:48.281612 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 9/17] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:24:48 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 285 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:48.405074 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-40a526d1-717f-4e6b-80a3-553041089c9a tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 352 microversion: 2.1 time: 0.188472 Aug 24 11:24:48.412271 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 9/18] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:48 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 352 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:24:49.290038 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2212d504-cbfc-4a23-ab34-c2e64b4fdf2a tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723f6ad160>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:49.371642 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2212d504-cbfc-4a23-ab34-c2e64b4fdf2a tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 200 len: 285 microversion: 2.1 time: 0.086551 Aug 24 11:24:49.373102 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 10/19] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:24:49 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:49.421688 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-dd7891f9-e23a-43c8-936f-3fc57cc72e53 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723f6aa550>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:49.533057 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-dd7891f9-e23a-43c8-936f-3fc57cc72e53 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 352 microversion: 2.1 time: 0.117235 Aug 24 11:24:49.539881 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 10/20] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:49 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:50.387198 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2769a8a1-8b8b-4508-81e1-79d295f19b05 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723f696dc0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:50.457543 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2769a8a1-8b8b-4508-81e1-79d295f19b05 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 200 len: 285 microversion: 2.1 time: 0.075343 Aug 24 11:24:50.458164 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 11/21] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:24:50 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 285 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:50.547506 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-79ae376d-d2c7-47de-aba7-e12c46398b6e tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723f698dc0>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:50.715081 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-79ae376d-d2c7-47de-aba7-e12c46398b6e tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 352 microversion: 2.1 time: 0.171365 Aug 24 11:24:50.716141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 11/22] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:50 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 352 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:51.271361 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6705b56d-44bc-4629-8e2d-8a2523952d19 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Action: 'create', calling method: .version_select at 0x7f723f6964c0>, body: {"keypair": {"name": "tempest-keypair-854208414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTUAxyKpSTmK0zUTXTBuoRGe5aPhjCpITdpTXVNIuZGux0LXwxdAtAubzltOYKeuUGaSOPe2xO2zmgU9ohOuI/HyowlII9qcTjSl4qS6kjVQr3fCH6NAV8Ym/7w7RoIww=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:51.392270 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-6705b56d-44bc-4629-8e2d-8a2523952d19 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Getting quotas for project 86e8de8aeabf4b8fa67ed0784fc39e46. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:24:51.408927 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-6705b56d-44bc-4629-8e2d-8a2523952d19 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Getting quotas for user cd79bc9c3a694fe2a4e3c645e682e438 and project 86e8de8aeabf4b8fa67ed0784fc39e46. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:24:51.477552 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2c768995-fa9a-4aa6-8fcd-43141cb38587 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723f698790>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:51.542753 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-2c768995-fa9a-4aa6-8fcd-43141cb38587 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 200 len: 285 microversion: 2.1 time: 0.073596 Aug 24 11:24:51.543567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 12/23] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:24:51 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 285 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:51.663668 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6705b56d-44bc-4629-8e2d-8a2523952d19 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.871091 Aug 24 11:24:51.664552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 12/24] 10.222.0.83 () {60 vars in 1159 bytes} [Wed Aug 24 11:24:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:24:51.730297 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-72b0a9a8-e596-4b92-9dcd-08a9106c3cf9 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723f6aa790>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:51.833400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-72b0a9a8-e596-4b92-9dcd-08a9106c3cf9 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 352 microversion: 2.1 time: 0.107443 Aug 24 11:24:51.843715 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 13/25] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:51 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:52.558705 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ac6f6337-c17c-47d8-bed9-5bbd8b53e0f3 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723f6aad30>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:52.626483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ac6f6337-c17c-47d8-bed9-5bbd8b53e0f3 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 200 len: 285 microversion: 2.1 time: 0.074614 Aug 24 11:24:52.627199 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 14/26] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:24:52 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 285 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:52.782348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1688843324", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "networks": [{"uuid": "e24358db-2f92-4318-ae81-b49368e71a79"}]}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:52.863399 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d1e9a2fe-8af7-42d1-8a27-447876da91a0 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723f6aab80>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:53.002648 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] validate_networks() for [('e24358db-2f92-4318-ae81-b49368e71a79', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:24:53.025445 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d1e9a2fe-8af7-42d1-8a27-447876da91a0 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 352 microversion: 2.1 time: 0.178014 Aug 24 11:24:53.026086 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 15/27] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:52 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 352 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:53.238676 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-126a904e-dc1c-4f20-ae9b-9e76c00e3080 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Action: 'create', calling method: .version_select at 0x7f723f6aa670>, body: {"keypair": {"name": "tempest-keypair-1413081741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXsw01hIyr7POfB6Ut7E2RDkrtmjnE2dIY164lFJBWTBbQQNzy/HOP5y+mAerdPa9neoTN/wr81PGEm3oLlpTIL0s+Xq4B4sz6EF7yVKmXuyGn/DmFCgZW4yEZrD5NOfw=="}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:53.327004 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-126a904e-dc1c-4f20-ae9b-9e76c00e3080 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for project 6e41187605624091a4edc1993c4357e4. Resources: {'key_pairs'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:24:53.347660 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-126a904e-dc1c-4f20-ae9b-9e76c00e3080 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for user 92712c36310c440c94da6c432c77a895 and project 6e41187605624091a4edc1993c4357e4. Resources: {'key_pairs'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:24:53.530166 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-126a904e-dc1c-4f20-ae9b-9e76c00e3080 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.421988 Aug 24 11:24:53.533019 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 16/28] 10.222.0.83 () {60 vars in 1159 bytes} [Wed Aug 24 11:24:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:24:53.641547 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-11b1c661-de46-4169-a693-5a6542d34f1f tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723f617b80>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:53.716379 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-11b1c661-de46-4169-a693-5a6542d34f1f tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 200 len: 285 microversion: 2.1 time: 0.080711 Aug 24 11:24:53.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 17/29] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:24:53 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 285 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:24:54.039982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-56f80154-3020-492e-93a9-807d2dd62b1d tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723edce280>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:54.116653 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-56f80154-3020-492e-93a9-807d2dd62b1d tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 352 microversion: 2.1 time: 0.080572 Aug 24 11:24:54.117627 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 18/30] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:54 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:24:54.700428 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:24:54.706787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:24:54.706787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:24:54.706787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:24:54.706787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:24:54.713748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:54.714824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:54.715474 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:54.716384 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:54.716979 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:54.717573 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:54.730695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8df9411c-c10c-4f21-a49f-eb1c2537dd81 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723edce940>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:54.754861 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Getting quotas for project b4b6d46119374e6ab76032a4db1198d5. Resources: {'cores', 'instances', 'ram'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:24:54.761739 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Getting quotas for user 4aa39f218d4d463291ffe15b929c4e2d and project b4b6d46119374e6ab76032a4db1198d5. Resources: {'cores', 'instances', 'ram'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:24:54.778248 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:24:54.784203 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:24:54.811885 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8df9411c-c10c-4f21-a49f-eb1c2537dd81 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 200 len: 286 microversion: 2.1 time: 0.084574 Aug 24 11:24:54.812915 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 19/31] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:24:54 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:54.823775 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6b1a0ea4-adc6-41de-9bf2-4bb3e79dfb2b tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723edcea60>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:54.973509 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9ae30e2b-b1ed-4f92-ba48-b9a4bd8a4ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.464870 Aug 24 11:24:54.974209 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 13/32] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:24:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:24:54.989920 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-089e9023-49fc-4749-92b2-36e305b0fd6d tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:54.990577 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-089e9023-49fc-4749-92b2-36e305b0fd6d tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:55.001190 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6b1a0ea4-adc6-41de-9bf2-4bb3e79dfb2b tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "DELETE /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 202 len: 0 microversion: 2.1 time: 0.181144 Aug 24 11:24:55.001765 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 20/33] 10.222.0.83 () {58 vars in 1254 bytes} [Wed Aug 24 11:24:54 2022] DELETE /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:24:55.009956 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-93872b8e-3a65-4eb1-bbbf-e21d74a03212 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723edce4c0>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:55.108905 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-93872b8e-3a65-4eb1-bbbf-e21d74a03212 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 200 len: 285 microversion: 2.1 time: 0.102397 Aug 24 11:24:55.113976 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 21/34] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:24:55 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:55.132430 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ef01c910-4668-42ce-b740-a000f9cc600e tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723f617e50>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:55.214242 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ef01c910-4668-42ce-b740-a000f9cc600e tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 352 microversion: 2.1 time: 0.076684 Aug 24 11:24:55.214874 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 22/35] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:55 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:55.265037 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-089e9023-49fc-4749-92b2-36e305b0fd6d tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:55.307130 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-089e9023-49fc-4749-92b2-36e305b0fd6d tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1215 microversion: 2.1 time: 0.324621 Aug 24 11:24:55.312319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 14/36] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:54 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1215 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:56.121603 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4042a9b4-2360-412f-86e0-8adfddccd9c0 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723edce160>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:56.162780 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4042a9b4-2360-412f-86e0-8adfddccd9c0 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 200 len: 285 microversion: 2.1 time: 0.044952 Aug 24 11:24:56.163829 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 23/37] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:24:56 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 285 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:56.228353 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-96d08a8c-f091-401a-9d43-caa7a5060493 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723ed76790>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:56.312979 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-96d08a8c-f091-401a-9d43-caa7a5060493 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 352 microversion: 2.1 time: 0.088403 Aug 24 11:24:56.315761 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 15/38] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:56 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:56.335335 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6f53664e-9911-498a-a4e9-e7283606187c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:56.336483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6f53664e-9911-498a-a4e9-e7283606187c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:56.517046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-526939387", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21673169-bb4e-4f8c-80b8-100bd684149a"}], "security_groups": [{"name": "tempest-securitygroup--865228897"}], "key_name": "tempest-keypair-854208414", "user_data": "}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:56.539304 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6f53664e-9911-498a-a4e9-e7283606187c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:56.567835 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6f53664e-9911-498a-a4e9-e7283606187c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1215 microversion: 2.1 time: 0.237896 Aug 24 11:24:56.568426 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 24/39] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:56 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:56.745386 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] validate_networks() for [('21673169-bb4e-4f8c-80b8-100bd684149a', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:24:57.177800 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6e618f45-c10c-49e9-97eb-8c33a52befdb tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723ed88310>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:57.234541 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6e618f45-c10c-49e9-97eb-8c33a52befdb tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 200 len: 285 microversion: 2.1 time: 0.061613 Aug 24 11:24:57.235918 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 25/40] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:24:57 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 285 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:24:57.334173 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-eaf5205a-0cef-4cb4-9e59-e8d1f2491105 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723ed958b0>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:57.445773 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-eaf5205a-0cef-4cb4-9e59-e8d1f2491105 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 352 microversion: 2.1 time: 0.116336 Aug 24 11:24:57.452281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 26/41] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:57 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:57.468309 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-680284746", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e65e35e5-b291-45e0-99cd-ea04855e4be5"}], "security_groups": [{"name": "tempest-securitygroup--183735587"}], "key_name": "tempest-keypair-1413081741", "user_data": "}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:24:57.551091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:24:57.551645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:24:57.551739 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:24:57.552101 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:24:57.552511 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:24:57.566784 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:57.567284 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:57.567901 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:57.568500 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:57.568878 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:57.569300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:57.635567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Getting quotas for project 86e8de8aeabf4b8fa67ed0784fc39e46. Resources: {'cores', 'instances', 'ram'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:24:57.642042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Getting quotas for user cd79bc9c3a694fe2a4e3c645e682e438 and project 86e8de8aeabf4b8fa67ed0784fc39e46. Resources: {'cores', 'instances', 'ram'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:24:57.656409 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:24:57.659720 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:24:57.766525 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] validate_networks() for [('e65e35e5-b291-45e0-99cd-ea04855e4be5', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:24:57.852063 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e0048594-d2e1-4905-88d7-7c57923fada2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.342600 Aug 24 11:24:57.859702 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 16/42] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:24:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:24:57.865034 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0afcc2cc-a100-40e2-a57b-9e874a524dfa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:57.865652 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0afcc2cc-a100-40e2-a57b-9e874a524dfa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:57.886249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0afcc2cc-a100-40e2-a57b-9e874a524dfa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:57.887023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0afcc2cc-a100-40e2-a57b-9e874a524dfa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:57.887624 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0afcc2cc-a100-40e2-a57b-9e874a524dfa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:57.888496 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0afcc2cc-a100-40e2-a57b-9e874a524dfa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:57.889101 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0afcc2cc-a100-40e2-a57b-9e874a524dfa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:57.889704 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0afcc2cc-a100-40e2-a57b-9e874a524dfa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:58.150510 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0afcc2cc-a100-40e2-a57b-9e874a524dfa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:58.182103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0afcc2cc-a100-40e2-a57b-9e874a524dfa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1219 microversion: 2.1 time: 0.318886 Aug 24 11:24:58.182889 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 17/43] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:57 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1219 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:58.190622 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cfaeca60-ca2f-4215-aeeb-31d6cf9966dd tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:58.202580 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cfaeca60-ca2f-4215-aeeb-31d6cf9966dd tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:58.333937 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cfaeca60-ca2f-4215-aeeb-31d6cf9966dd tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:58.341545 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cfaeca60-ca2f-4215-aeeb-31d6cf9966dd tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1236 microversion: 2.1 time: 0.157748 Aug 24 11:24:58.343443 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 18/44] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:58 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1236 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:58.353031 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-99b3b808-aa69-432f-825b-78858e74aaa1 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723dd18d30>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:58.392037 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-99b3b808-aa69-432f-825b-78858e74aaa1 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 200 len: 285 microversion: 2.1 time: 0.042892 Aug 24 11:24:58.392037 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 19/45] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:24:58 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 285 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:58.476299 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f9edc775-385d-47b3-a3df-4ad17c4e9899 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723dc9c550>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:58.583279 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f9edc775-385d-47b3-a3df-4ad17c4e9899 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 352 microversion: 2.1 time: 0.127803 Aug 24 11:24:58.584570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 20/46] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:58 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:59.023296 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:24:59.029595 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:24:59.033087 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:24:59.033703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:24:59.034172 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:24:59.046900 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:59.047495 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:59.048038 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:59.049290 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:59.050186 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:59.051268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:59.122509 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for project 6e41187605624091a4edc1993c4357e4. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:24:59.129184 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for user 92712c36310c440c94da6c432c77a895 and project 6e41187605624091a4edc1993c4357e4. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:24:59.160947 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:24:59.164311 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:24:59.203720 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-50452d16-94e3-461e-88e9-7f5cd3442842 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:59.204680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-50452d16-94e3-461e-88e9-7f5cd3442842 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:59.211754 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50452d16-94e3-461e-88e9-7f5cd3442842 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:59.212242 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50452d16-94e3-461e-88e9-7f5cd3442842 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:59.212684 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50452d16-94e3-461e-88e9-7f5cd3442842 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:59.213384 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50452d16-94e3-461e-88e9-7f5cd3442842 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:24:59.213864 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50452d16-94e3-461e-88e9-7f5cd3442842 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:24:59.214324 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50452d16-94e3-461e-88e9-7f5cd3442842 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:24:59.317736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-50452d16-94e3-461e-88e9-7f5cd3442842 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:59.334117 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-50452d16-94e3-461e-88e9-7f5cd3442842 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1219 microversion: 2.1 time: 0.130583 Aug 24 11:24:59.334117 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 21/47] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:59 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:24:59.376065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-55f62c8b-37f1-4392-9808-c1ed807c723e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.914054 Aug 24 11:24:59.378250 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8d2529a1-9d7f-4b91-85b8-99cbb5f2ca1c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:59.378979 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8d2529a1-9d7f-4b91-85b8-99cbb5f2ca1c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:59.380913 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 27/48] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:24:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:24:59.406438 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8294204c-e3f8-4726-b532-10d5e166a493 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:59.407173 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8294204c-e3f8-4726-b532-10d5e166a493 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:24:59.494575 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8d2529a1-9d7f-4b91-85b8-99cbb5f2ca1c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:59.504597 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8d2529a1-9d7f-4b91-85b8-99cbb5f2ca1c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1236 microversion: 2.1 time: 0.143161 Aug 24 11:24:59.506586 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 22/49] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:59 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1236 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:59.518858 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8a579857-4d01-4309-bc0b-8ff920a6dd2e tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723dc9c9d0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:59.548174 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8294204c-e3f8-4726-b532-10d5e166a493 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:24:59.562387 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8294204c-e3f8-4726-b532-10d5e166a493 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1241 microversion: 2.1 time: 0.174039 Aug 24 11:24:59.565829 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 28/50] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:24:59 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1241 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:24:59.588991 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8a579857-4d01-4309-bc0b-8ff920a6dd2e tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 200 len: 285 microversion: 2.1 time: 0.081244 Aug 24 11:24:59.589604 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 23/51] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:24:59 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 285 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:24:59.598363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3a2380ee-38b6-47df-b490-112709a0293b tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723ed29ee0>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:24:59.673395 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3a2380ee-38b6-47df-b490-112709a0293b tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 200 len: 352 microversion: 2.1 time: 0.079366 Aug 24 11:24:59.674179 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 29/52] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:24:59 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:00.350823 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dfa6e6fb-8b0f-42be-9ceb-fb490b8e03a6 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:00.351835 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-dfa6e6fb-8b0f-42be-9ceb-fb490b8e03a6 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:00.361563 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfa6e6fb-8b0f-42be-9ceb-fb490b8e03a6 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:00.362427 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfa6e6fb-8b0f-42be-9ceb-fb490b8e03a6 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:00.363212 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfa6e6fb-8b0f-42be-9ceb-fb490b8e03a6 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:00.364198 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfa6e6fb-8b0f-42be-9ceb-fb490b8e03a6 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:00.364835 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfa6e6fb-8b0f-42be-9ceb-fb490b8e03a6 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:00.365837 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfa6e6fb-8b0f-42be-9ceb-fb490b8e03a6 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:00.473640 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dfa6e6fb-8b0f-42be-9ceb-fb490b8e03a6 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:00.486250 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-dfa6e6fb-8b0f-42be-9ceb-fb490b8e03a6 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1267 microversion: 2.1 time: 0.137556 Aug 24 11:25:00.494058 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 24/53] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:00 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:00.530343 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-83c936ad-2ccb-49b0-a100-4cbcfdaab676 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:00.536127 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-83c936ad-2ccb-49b0-a100-4cbcfdaab676 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:00.544986 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-83c936ad-2ccb-49b0-a100-4cbcfdaab676 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:00.545507 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-83c936ad-2ccb-49b0-a100-4cbcfdaab676 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:00.548344 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-83c936ad-2ccb-49b0-a100-4cbcfdaab676 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:00.549128 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-83c936ad-2ccb-49b0-a100-4cbcfdaab676 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:00.550389 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-83c936ad-2ccb-49b0-a100-4cbcfdaab676 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:00.564363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-83c936ad-2ccb-49b0-a100-4cbcfdaab676 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:00.599657 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6742c86e-a53a-4e3f-9e8b-4d8df7b5f651 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:00.605033 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6742c86e-a53a-4e3f-9e8b-4d8df7b5f651 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:00.700619 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6742c86e-a53a-4e3f-9e8b-4d8df7b5f651 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:00.708704 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6742c86e-a53a-4e3f-9e8b-4d8df7b5f651 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1241 microversion: 2.1 time: 0.123345 Aug 24 11:25:00.709611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 25/54] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:00 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:00.714354 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e0bec3d7-76c6-4ca9-b5c5-69ab10987a15 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723dc9cdc0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:00.752024 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-e0bec3d7-76c6-4ca9-b5c5-69ab10987a15 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] HTTP exception thrown: Snapshot 8ec140a8-96a7-4a39-b350-5f3a0135b5b6 could not be found. Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e0bec3d7-76c6-4ca9-b5c5-69ab10987a15 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Request method failure captured: Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 HTTP/1.1 Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgp4d_3xdzCINPI4lOqrhl-KZLOdnwLYRcHn-P66mc2yCSOoxsrWA1w4GgFZBfrl5YKLyOYQLYerAlqzi0Z-6J1Rb_R-feORvyjnr79NkKgib9ypGdm_W5UuwdNYLLKM3kDSXhMx2qaY3j1_ga4ouVjlepub0dZPbujZR7EEEZtXLPA Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 6546cd2088ee4c29890d6841ac1a2686 Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1793445209 Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:25:00.757158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:25:00.758370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6546cd2088ee4c29890d6841ac1a2686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6546cd2088ee4c29890d6841ac1a2686"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6546cd2088ee4c29890d6841ac1a2686", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6546cd2088ee4c29890d6841ac1a2686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:25:00.758370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1793445209 Aug 24 11:25:00.758370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 6546cd2088ee4c29890d6841ac1a2686 Aug 24 11:25:00.758370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1793445209 Aug 24 11:25:00.758370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesSnapshotsTestJSON-1793445209-project Aug 24 11:25:00.758370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:25:00.758370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:25:00.758370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 64db87b93e5544f1a6b8167e2003e200 Aug 24 11:25:00.758370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1793445209-project Aug 24 11:25:00.758370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: Aug 24 11:25:00.758370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Snapshot 8ec140a8-96a7-4a39-b350-5f3a0135b5b6 could not be found. Aug 24 11:25:00.758370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '8ec140a8-96a7-4a39-b350-5f3a0135b5b6'} Aug 24 11:25:00.758370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8ec140a8-96a7-4a39-b350-5f3a0135b5b6 could not be found. (HTTP 404) (Request-ID: req-9dd2050b-5599-4ac2-912d-647409119e73) Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:00.759277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:25:00.760369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8ec140a8-96a7-4a39-b350-5f3a0135b5b6 could not be found. Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 11:25:00.761489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:00.762793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8ec140a8-96a7-4a39-b350-5f3a0135b5b6 could not be found. Aug 24 11:25:00.762793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:00.762793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:00.762793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:00.762793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:00.762793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:00.762793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:00.762793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:00.762793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:00.762793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8ec140a8-96a7-4a39-b350-5f3a0135b5b6 could not be found. Aug 24 11:25:00.762793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:00.762793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e0bec3d7-76c6-4ca9-b5c5-69ab10987a15 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Returning 404 to user: Snapshot 8ec140a8-96a7-4a39-b350-5f3a0135b5b6 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:00.764117 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e0bec3d7-76c6-4ca9-b5c5-69ab10987a15 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6" status: 404 len: 111 microversion: 2.1 time: 0.053330 Aug 24 11:25:00.766398 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 26/55] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:25:00 2022] GET /compute/v2.1/os-snapshots/8ec140a8-96a7-4a39-b350-5f3a0135b5b6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:25:00.773985 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-24bb95a4-d678-4d58-ab67-97821b1ebdc9 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Calling method '.version_select at 0x7f723dc7b9d0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:00.880101 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-24bb95a4-d678-4d58-ab67-97821b1ebdc9 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] HTTP exception thrown: Volume c6ddfed0-f30f-4770-ba21-74057c0c046a could not be found. Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-24bb95a4-d678-4d58-ab67-97821b1ebdc9 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Request method failure captured: Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a HTTP/1.1 Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgp2cgq1w83yztpq_k1TnWngekYpxLWY5BjQ_kaKYueUYSn7sIvtxdb3tcoKcnQBGnyC9rRW_NkOzpQSBsumAUgKy5wgtStm0tarVeG1BfyPaT1bXCAnFuM2kFhGjIoC52sumq7WjGMvWlHEOfKNcRSIqiGQ0GE3Kzz9YFV70sgGlNs Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 4261e17a79fa4878a2fd3da019e13b5b Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesGetTestJSON-315876759 Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:25:00.882682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:25:00.883999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/4261e17a79fa4878a2fd3da019e13b5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4261e17a79fa4878a2fd3da019e13b5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_4261e17a79fa4878a2fd3da019e13b5b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4261e17a79fa4878a2fd3da019e13b5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:25:00.883999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesGetTestJSON-315876759 Aug 24 11:25:00.883999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 4261e17a79fa4878a2fd3da019e13b5b Aug 24 11:25:00.883999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesGetTestJSON-315876759 Aug 24 11:25:00.883999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesGetTestJSON-315876759-project Aug 24 11:25:00.883999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:25:00.883999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:25:00.883999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 5baa38db92664d50a96672b9f57f4c3b Aug 24 11:25:00.883999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesGetTestJSON-315876759-project Aug 24 11:25:00.883999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: Aug 24 11:25:00.883999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Volume c6ddfed0-f30f-4770-ba21-74057c0c046a could not be found. Aug 24 11:25:00.883999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': 'c6ddfed0-f30f-4770-ba21-74057c0c046a'} Aug 24 11:25:00.883999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6ddfed0-f30f-4770-ba21-74057c0c046a could not be found. (HTTP 404) (Request-ID: req-f25f5a4d-ab07-40a2-9941-afbdf7691c96) Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:00.884824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:25:00.886023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6ddfed0-f30f-4770-ba21-74057c0c046a could not be found. Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:25:00.887175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:00.889910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6ddfed0-f30f-4770-ba21-74057c0c046a could not be found. Aug 24 11:25:00.889910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:00.889910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:00.889910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:00.889910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:00.889910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:00.889910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:00.889910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:00.889910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:00.889910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6ddfed0-f30f-4770-ba21-74057c0c046a could not be found. Aug 24 11:25:00.889910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:00.889910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-24bb95a4-d678-4d58-ab67-97821b1ebdc9 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] Returning 404 to user: Volume c6ddfed0-f30f-4770-ba21-74057c0c046a could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:00.889910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-24bb95a4-d678-4d58-ab67-97821b1ebdc9 tempest-VolumesGetTestJSON-315876759 tempest-VolumesGetTestJSON-315876759-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a" status: 404 len: 109 microversion: 2.1 time: 0.115986 Aug 24 11:25:00.892633 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 27/56] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:25:00 2022] GET /compute/v2.1/os-volumes/c6ddfed0-f30f-4770-ba21-74057c0c046a => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:25:00.898410 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a2cebf3d-d663-457e-994b-8d5b48272b6c tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723dc7b4c0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:00.947154 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-83c936ad-2ccb-49b0-a100-4cbcfdaab676 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:00.975620 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-83c936ad-2ccb-49b0-a100-4cbcfdaab676 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1240 microversion: 2.1 time: 0.451917 Aug 24 11:25:00.979432 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 30/57] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:00 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1240 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:00.986247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7fd32011-a1ba-4e6f-a71e-3fc8b1c58b10 tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] Calling method '.version_select at 0x7f723ed29c10>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:01.273911 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a2cebf3d-d663-457e-994b-8d5b48272b6c tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b" status: 202 len: 0 microversion: 2.1 time: 0.379600 Aug 24 11:25:01.275377 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 28/58] 10.222.0.83 () {58 vars in 1248 bytes} [Wed Aug 24 11:25:00 2022] DELETE /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:25:01.292734 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d2adeef9-91a5-4cb7-92f6-2345981ac79a tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723dbe4310>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:01.352913 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7fd32011-a1ba-4e6f-a71e-3fc8b1c58b10 tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/76de6ab0-3940-4bd8-aa60-cbe7c26070d1" status: 200 len: 351 microversion: 2.1 time: 0.372063 Aug 24 11:25:01.353828 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 31/59] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:25:00 2022] GET /compute/v2.1/os-volumes/76de6ab0-3940-4bd8-aa60-cbe7c26070d1 => generated 351 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:01.377788 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5d3def39-d08f-4ecb-bd95-ffb595f16026 tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] Calling method '.version_select at 0x7f723dc8d8b0>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:01.527709 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d2adeef9-91a5-4cb7-92f6-2345981ac79a tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b" status: 200 len: 345 microversion: 2.1 time: 0.245796 Aug 24 11:25:01.528827 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 29/60] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:25:01 2022] GET /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b => generated 345 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:01.558482 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ac05f903-ee56-467c-a93f-6c01a63b673b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:01.559097 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ac05f903-ee56-467c-a93f-6c01a63b673b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:01.579942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac05f903-ee56-467c-a93f-6c01a63b673b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:01.580450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac05f903-ee56-467c-a93f-6c01a63b673b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:01.581185 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac05f903-ee56-467c-a93f-6c01a63b673b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:01.586424 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac05f903-ee56-467c-a93f-6c01a63b673b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:01.595144 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac05f903-ee56-467c-a93f-6c01a63b673b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:01.595144 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac05f903-ee56-467c-a93f-6c01a63b673b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:01.680758 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5d3def39-d08f-4ecb-bd95-ffb595f16026 tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.309221 Aug 24 11:25:01.681734 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 32/61] 10.222.0.83 () {58 vars in 1134 bytes} [Wed Aug 24 11:25:01 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:01.699877 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3cf63212-e0a9-4c54-a00d-c70f2a981558 tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] Calling method '.version_select at 0x7f723dc9a4c0>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:01.786786 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ac05f903-ee56-467c-a93f-6c01a63b673b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:01.795745 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ac05f903-ee56-467c-a93f-6c01a63b673b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1273 microversion: 2.1 time: 0.264526 Aug 24 11:25:01.796347 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 30/62] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:01 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:01.817380 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b6993b1a-95e8-4226-acca-9a0c4772e623 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:01.818590 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b6993b1a-95e8-4226-acca-9a0c4772e623 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:01.833207 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6993b1a-95e8-4226-acca-9a0c4772e623 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:01.834506 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6993b1a-95e8-4226-acca-9a0c4772e623 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:01.834964 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6993b1a-95e8-4226-acca-9a0c4772e623 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:01.835701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6993b1a-95e8-4226-acca-9a0c4772e623 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:01.840112 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6993b1a-95e8-4226-acca-9a0c4772e623 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:01.840751 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6993b1a-95e8-4226-acca-9a0c4772e623 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:01.864069 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3cf63212-e0a9-4c54-a00d-c70f2a981558 tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.168466 Aug 24 11:25:01.865029 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 33/63] 10.222.0.83 () {58 vars in 1149 bytes} [Wed Aug 24 11:25:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:25:01.887937 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-739f6309-c67b-469a-92e4-2083596b981e tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] Calling method '.version_select at 0x7f723dcb7940>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:01.945299 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b6993b1a-95e8-4226-acca-9a0c4772e623 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:02.001924 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b6993b1a-95e8-4226-acca-9a0c4772e623 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1237 microversion: 2.1 time: 0.200441 Aug 24 11:25:02.004033 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 31/64] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:01 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1237 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:02.028626 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1da33488-e9d0-4213-8c73-670afa865977 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:02.029303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1da33488-e9d0-4213-8c73-670afa865977 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:02.056048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1da33488-e9d0-4213-8c73-670afa865977 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:02.056048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1da33488-e9d0-4213-8c73-670afa865977 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:02.056048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1da33488-e9d0-4213-8c73-670afa865977 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:02.056048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1da33488-e9d0-4213-8c73-670afa865977 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:02.056479 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1da33488-e9d0-4213-8c73-670afa865977 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:02.058976 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1da33488-e9d0-4213-8c73-670afa865977 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:02.210395 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-739f6309-c67b-469a-92e4-2083596b981e tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.330854 Aug 24 11:25:02.211704 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 34/65] 10.222.0.83 () {58 vars in 1134 bytes} [Wed Aug 24 11:25:01 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:02.223503 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1da33488-e9d0-4213-8c73-670afa865977 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:02.225886 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f38170f5-9d2f-4c7b-a8cb-66a8c36f0a2d tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] Calling method '.version_select at 0x7f723dc9a5e0>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:02.232798 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1da33488-e9d0-4213-8c73-670afa865977 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1288 microversion: 2.1 time: 0.227626 Aug 24 11:25:02.252111 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 32/66] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:02 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1288 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:02.392480 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f38170f5-9d2f-4c7b-a8cb-66a8c36f0a2d tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.170846 Aug 24 11:25:02.393091 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 35/67] 10.222.0.83 () {58 vars in 1167 bytes} [Wed Aug 24 11:25:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:02.407771 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-398342c5-7238-4a1d-a833-f31df356c5fe tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] Calling method '.version_select at 0x7f723db7ec10>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:02.543840 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e9535916-ade1-44b5-a6c1-d869d451a6fd tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723dc8dc10>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:02.625257 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-398342c5-7238-4a1d-a833-f31df356c5fe tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.221693 Aug 24 11:25:02.625829 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 33/68] 10.222.0.83 () {58 vars in 1170 bytes} [Wed Aug 24 11:25:02 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:02.639418 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-854431c0-9cdc-42be-8341-81bbb210ead1 tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] Calling method '.version_select at 0x7f723dbfa3a0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:02.797277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-e9535916-ade1-44b5-a6c1-d869d451a6fd tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] HTTP exception thrown: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e9535916-ade1-44b5-a6c1-d869d451a6fd tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Request method failure captured: Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: GET /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b HTTP/1.1 Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgp4d_3xdzCINPI4lOqrhl-KZLOdnwLYRcHn-P66mc2yCSOoxsrWA1w4GgFZBfrl5YKLyOYQLYerAlqzi0Z-6J1Rb_R-feORvyjnr79NkKgib9ypGdm_W5UuwdNYLLKM3kDSXhMx2qaY3j1_ga4ouVjlepub0dZPbujZR7EEEZtXLPA Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 6546cd2088ee4c29890d6841ac1a2686 Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1793445209 Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:25:02.805180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:25:02.806566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6546cd2088ee4c29890d6841ac1a2686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6546cd2088ee4c29890d6841ac1a2686"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6546cd2088ee4c29890d6841ac1a2686", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6546cd2088ee4c29890d6841ac1a2686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:25:02.806566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1793445209 Aug 24 11:25:02.806566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 6546cd2088ee4c29890d6841ac1a2686 Aug 24 11:25:02.806566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1793445209 Aug 24 11:25:02.806566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-VolumesSnapshotsTestJSON-1793445209-project Aug 24 11:25:02.806566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:25:02.806566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:25:02.806566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 64db87b93e5544f1a6b8167e2003e200 Aug 24 11:25:02.806566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1793445209-project Aug 24 11:25:02.806566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: Aug 24 11:25:02.806566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:02.806566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': 'f1f3a1a1-fe81-4980-8fa1-e673b12a152b'} Aug 24 11:25:02.806566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. (HTTP 404) (Request-ID: req-516ee704-1e4d-4564-b6b6-46a9489f5cec) Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:02.807247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:25:02.808237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:25:02.810261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:02.811263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:02.811263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:25:02.811263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:02.811263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:25:02.811263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:02.811263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:02.811263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:02.811263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:02.811263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:02.811263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:02.811263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:25:02.811263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e9535916-ade1-44b5-a6c1-d869d451a6fd tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Returning 404 to user: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:02.811263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e9535916-ade1-44b5-a6c1-d869d451a6fd tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b" status: 404 len: 109 microversion: 2.1 time: 0.264115 Aug 24 11:25:02.811263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 36/69] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:25:02 2022] GET /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b => generated 109 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:25:02.823794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-fcd108de-b1d1-421b-b7bd-26e9014b5f15 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:02.833765 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-fcd108de-b1d1-421b-b7bd-26e9014b5f15 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:02.858615 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fcd108de-b1d1-421b-b7bd-26e9014b5f15 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:02.859156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fcd108de-b1d1-421b-b7bd-26e9014b5f15 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:02.867621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fcd108de-b1d1-421b-b7bd-26e9014b5f15 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:02.868840 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fcd108de-b1d1-421b-b7bd-26e9014b5f15 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:02.869014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fcd108de-b1d1-421b-b7bd-26e9014b5f15 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:02.874311 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fcd108de-b1d1-421b-b7bd-26e9014b5f15 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:03.002074 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-854431c0-9cdc-42be-8341-81bbb210ead1 tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.366408 Aug 24 11:25:03.003148 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 34/70] 10.222.0.83 () {58 vars in 1155 bytes} [Wed Aug 24 11:25:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:03.008235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a2fbf91b-15c2-43fd-b87d-eb40f165ad49 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723dbb13a0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:03.276410 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-a2fbf91b-15c2-43fd-b87d-eb40f165ad49 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] HTTP exception thrown: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a2fbf91b-15c2-43fd-b87d-eb40f165ad49 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Request method failure captured: Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b HTTP/1.1 Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgp4d_3xdzCINPI4lOqrhl-KZLOdnwLYRcHn-P66mc2yCSOoxsrWA1w4GgFZBfrl5YKLyOYQLYerAlqzi0Z-6J1Rb_R-feORvyjnr79NkKgib9ypGdm_W5UuwdNYLLKM3kDSXhMx2qaY3j1_ga4ouVjlepub0dZPbujZR7EEEZtXLPA Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 6546cd2088ee4c29890d6841ac1a2686 Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1793445209 Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:25:03.278882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:25:03.280830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6546cd2088ee4c29890d6841ac1a2686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6546cd2088ee4c29890d6841ac1a2686"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6546cd2088ee4c29890d6841ac1a2686", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6546cd2088ee4c29890d6841ac1a2686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:25:03.280830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1793445209 Aug 24 11:25:03.280830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 6546cd2088ee4c29890d6841ac1a2686 Aug 24 11:25:03.280830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1793445209 Aug 24 11:25:03.280830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesSnapshotsTestJSON-1793445209-project Aug 24 11:25:03.280830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:25:03.280830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:25:03.280830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 64db87b93e5544f1a6b8167e2003e200 Aug 24 11:25:03.280830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1793445209-project Aug 24 11:25:03.280830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: Aug 24 11:25:03.280830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:03.280830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': 'f1f3a1a1-fe81-4980-8fa1-e673b12a152b'} Aug 24 11:25:03.280830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. (HTTP 404) (Request-ID: req-87807cbb-b98f-43a0-a0ec-24040f4ba4d5) Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:03.281603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:25:03.295160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 11:25:03.297008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:03.298133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:03.298133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:03.298133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:03.298133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:03.298133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:03.298133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:03.298133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:03.298133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:03.298133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:03.298133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:03.298133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:03.298133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a2fbf91b-15c2-43fd-b87d-eb40f165ad49 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Returning 404 to user: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:03.298133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a2fbf91b-15c2-43fd-b87d-eb40f165ad49 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b" status: 404 len: 109 microversion: 2.1 time: 0.280132 Aug 24 11:25:03.298133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 35/71] 10.222.0.83 () {58 vars in 1248 bytes} [Wed Aug 24 11:25:03 2022] DELETE /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b => generated 109 bytes in 286 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:25:03.300380 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9566b5c8-9212-48b9-8f88-95cc59b86c78 tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] Calling method '.version_select at 0x7f723dbe4dc0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:03.442933 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9566b5c8-9212-48b9-8f88-95cc59b86c78 tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.151339 Aug 24 11:25:03.453411 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 36/72] 10.222.0.83 () {58 vars in 1188 bytes} [Wed Aug 24 11:25:03 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:03.453411 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-66dde1d7-e6af-409d-a25a-cbeeff5ebb03 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:03.453411 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-66dde1d7-e6af-409d-a25a-cbeeff5ebb03 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:03.469584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66dde1d7-e6af-409d-a25a-cbeeff5ebb03 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:03.470286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66dde1d7-e6af-409d-a25a-cbeeff5ebb03 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:03.471419 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66dde1d7-e6af-409d-a25a-cbeeff5ebb03 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:03.472340 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66dde1d7-e6af-409d-a25a-cbeeff5ebb03 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:03.472871 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66dde1d7-e6af-409d-a25a-cbeeff5ebb03 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:03.473385 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66dde1d7-e6af-409d-a25a-cbeeff5ebb03 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:03.545148 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-fcd108de-b1d1-421b-b7bd-26e9014b5f15 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:03.563522 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-fcd108de-b1d1-421b-b7bd-26e9014b5f15 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.749444 Aug 24 11:25:03.564142 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 37/73] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:02 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:03.580657 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-08798029-c7cc-44b0-b656-f6d88a67c937 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:03.581280 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-08798029-c7cc-44b0-b656-f6d88a67c937 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:03.607672 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-08798029-c7cc-44b0-b656-f6d88a67c937 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:03.608555 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-08798029-c7cc-44b0-b656-f6d88a67c937 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:03.609000 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-08798029-c7cc-44b0-b656-f6d88a67c937 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:03.609711 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-08798029-c7cc-44b0-b656-f6d88a67c937 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:03.618803 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-66dde1d7-e6af-409d-a25a-cbeeff5ebb03 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:03.620581 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-08798029-c7cc-44b0-b656-f6d88a67c937 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:03.621754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-08798029-c7cc-44b0-b656-f6d88a67c937 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:03.635283 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-66dde1d7-e6af-409d-a25a-cbeeff5ebb03 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1301 microversion: 2.1 time: 0.190083 Aug 24 11:25:03.653098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 37/74] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:03 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1301 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:03.668112 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-66a4a026-e05f-4eec-b7f6-391a31cf4c15 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Calling method '.version_select at 0x7f723dc7b700>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:03.737811 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-66a4a026-e05f-4eec-b7f6-391a31cf4c15 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] HTTP exception thrown: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-66a4a026-e05f-4eec-b7f6-391a31cf4c15 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Request method failure captured: Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b HTTP/1.1 Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgp4d_3xdzCINPI4lOqrhl-KZLOdnwLYRcHn-P66mc2yCSOoxsrWA1w4GgFZBfrl5YKLyOYQLYerAlqzi0Z-6J1Rb_R-feORvyjnr79NkKgib9ypGdm_W5UuwdNYLLKM3kDSXhMx2qaY3j1_ga4ouVjlepub0dZPbujZR7EEEZtXLPA Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 6546cd2088ee4c29890d6841ac1a2686 Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1793445209 Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:25:03.739866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:25:03.740912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6546cd2088ee4c29890d6841ac1a2686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6546cd2088ee4c29890d6841ac1a2686"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6546cd2088ee4c29890d6841ac1a2686", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6546cd2088ee4c29890d6841ac1a2686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:25:03.740912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1793445209 Aug 24 11:25:03.740912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 6546cd2088ee4c29890d6841ac1a2686 Aug 24 11:25:03.740912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1793445209 Aug 24 11:25:03.740912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesSnapshotsTestJSON-1793445209-project Aug 24 11:25:03.740912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:25:03.740912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:25:03.740912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 64db87b93e5544f1a6b8167e2003e200 Aug 24 11:25:03.740912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1793445209-project Aug 24 11:25:03.740912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: Aug 24 11:25:03.740912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:03.740912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': 'f1f3a1a1-fe81-4980-8fa1-e673b12a152b'} Aug 24 11:25:03.740912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. (HTTP 404) (Request-ID: req-afb8bedc-0c6e-4d8b-b6e5-71629e08eab8) Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:03.741614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:25:03.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:25:03.750258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:25:03.751239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:03.751239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:03.751239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:25:03.751239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:03.751239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:25:03.751239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:25:03.751239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:25:03.751239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:25:03.751239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:25:03.751239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. Aug 24 11:25:03.751239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:25:03.751239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-66a4a026-e05f-4eec-b7f6-391a31cf4c15 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] Returning 404 to user: Volume f1f3a1a1-fe81-4980-8fa1-e673b12a152b could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:25:03.751239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-66a4a026-e05f-4eec-b7f6-391a31cf4c15 tempest-VolumesSnapshotsTestJSON-1793445209 tempest-VolumesSnapshotsTestJSON-1793445209-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b" status: 404 len: 109 microversion: 2.1 time: 0.086995 Aug 24 11:25:03.751239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 38/75] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:25:03 2022] GET /compute/v2.1/os-volumes/f1f3a1a1-fe81-4980-8fa1-e673b12a152b => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:25:03.751937 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cb9ad484-8acd-48e2-b5dd-f8d621013197 tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] Calling method '.version_select at 0x7f723dbe4670>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:03.792464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-08798029-c7cc-44b0-b656-f6d88a67c937 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:03.809543 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-08798029-c7cc-44b0-b656-f6d88a67c937 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1294 microversion: 2.1 time: 0.234360 Aug 24 11:25:03.811552 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 38/76] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:03 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1294 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:03.977101 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cb9ad484-8acd-48e2-b5dd-f8d621013197 tempest-VolumesTestJSON-1478925596 tempest-VolumesTestJSON-1478925596-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.230575 Aug 24 11:25:03.990762 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 39/77] 10.222.0.83 () {58 vars in 1155 bytes} [Wed Aug 24 11:25:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:04.589427 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0f8cd2ed-6ecd-4540-953d-56f201633f2c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:04.590443 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0f8cd2ed-6ecd-4540-953d-56f201633f2c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:04.648663 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f8cd2ed-6ecd-4540-953d-56f201633f2c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:04.652570 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f8cd2ed-6ecd-4540-953d-56f201633f2c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:04.653222 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f8cd2ed-6ecd-4540-953d-56f201633f2c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:04.654261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f8cd2ed-6ecd-4540-953d-56f201633f2c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:04.655619 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f8cd2ed-6ecd-4540-953d-56f201633f2c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:04.657318 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f8cd2ed-6ecd-4540-953d-56f201633f2c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:04.659056 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1f238902-9456-46e8-9353-84e83c6b899a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:04.659871 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1f238902-9456-46e8-9353-84e83c6b899a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:04.690320 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f238902-9456-46e8-9353-84e83c6b899a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:04.698444 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f238902-9456-46e8-9353-84e83c6b899a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:04.698913 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f238902-9456-46e8-9353-84e83c6b899a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:04.699693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f238902-9456-46e8-9353-84e83c6b899a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:04.706432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f238902-9456-46e8-9353-84e83c6b899a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:04.706907 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f238902-9456-46e8-9353-84e83c6b899a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:04.858621 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1f238902-9456-46e8-9353-84e83c6b899a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:04.867376 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1f238902-9456-46e8-9353-84e83c6b899a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1299 microversion: 2.1 time: 0.213988 Aug 24 11:25:04.872100 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 40/78] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:04 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1299 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:04.886742 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-042c73bf-e473-4ddb-bb94-522af2c8588a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:04.887584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-042c73bf-e473-4ddb-bb94-522af2c8588a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:04.899627 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-042c73bf-e473-4ddb-bb94-522af2c8588a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:04.900479 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-042c73bf-e473-4ddb-bb94-522af2c8588a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:04.901719 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-042c73bf-e473-4ddb-bb94-522af2c8588a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:04.902658 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-042c73bf-e473-4ddb-bb94-522af2c8588a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:04.903813 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-042c73bf-e473-4ddb-bb94-522af2c8588a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:04.904443 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-042c73bf-e473-4ddb-bb94-522af2c8588a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:05.216229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-042c73bf-e473-4ddb-bb94-522af2c8588a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:05.229193 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-042c73bf-e473-4ddb-bb94-522af2c8588a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1294 microversion: 2.1 time: 0.354082 Aug 24 11:25:05.246724 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 41/79] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:04 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1294 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:05.251901 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0f8cd2ed-6ecd-4540-953d-56f201633f2c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:05.263137 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0f8cd2ed-6ecd-4540-953d-56f201633f2c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.681377 Aug 24 11:25:05.265904 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 39/80] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:04 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:05.893075 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e7ce202d-a0d2-469a-a5ab-512bde3d72a0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:05.893647 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e7ce202d-a0d2-469a-a5ab-512bde3d72a0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:05.903142 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e7ce202d-a0d2-469a-a5ab-512bde3d72a0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:05.903644 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e7ce202d-a0d2-469a-a5ab-512bde3d72a0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:05.904082 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e7ce202d-a0d2-469a-a5ab-512bde3d72a0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:05.915303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e7ce202d-a0d2-469a-a5ab-512bde3d72a0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:05.915303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e7ce202d-a0d2-469a-a5ab-512bde3d72a0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:05.915303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e7ce202d-a0d2-469a-a5ab-512bde3d72a0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:06.087938 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e7ce202d-a0d2-469a-a5ab-512bde3d72a0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:06.122954 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e7ce202d-a0d2-469a-a5ab-512bde3d72a0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1299 microversion: 2.1 time: 0.232300 Aug 24 11:25:06.138834 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 42/81] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:05 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1299 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:06.265555 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-84c0e175-6a7b-4463-ae85-acd1da21fce0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:06.266537 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-84c0e175-6a7b-4463-ae85-acd1da21fce0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:06.275277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-84c0e175-6a7b-4463-ae85-acd1da21fce0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:06.275789 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-84c0e175-6a7b-4463-ae85-acd1da21fce0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:06.279299 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-84c0e175-6a7b-4463-ae85-acd1da21fce0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:06.279299 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-84c0e175-6a7b-4463-ae85-acd1da21fce0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:06.279299 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-84c0e175-6a7b-4463-ae85-acd1da21fce0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:06.279299 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-84c0e175-6a7b-4463-ae85-acd1da21fce0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:06.300952 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-76888790-ee23-4041-8aa8-4c9db78a907e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:06.301851 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-76888790-ee23-4041-8aa8-4c9db78a907e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:06.312291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76888790-ee23-4041-8aa8-4c9db78a907e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:06.316601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76888790-ee23-4041-8aa8-4c9db78a907e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:06.316601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76888790-ee23-4041-8aa8-4c9db78a907e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:06.316601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76888790-ee23-4041-8aa8-4c9db78a907e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:06.316601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76888790-ee23-4041-8aa8-4c9db78a907e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:06.317999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76888790-ee23-4041-8aa8-4c9db78a907e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:06.849729 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-76888790-ee23-4041-8aa8-4c9db78a907e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:06.862726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-76888790-ee23-4041-8aa8-4c9db78a907e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.565801 Aug 24 11:25:06.863541 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 43/82] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:06 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:06.993776 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-84c0e175-6a7b-4463-ae85-acd1da21fce0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:07.018860 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-84c0e175-6a7b-4463-ae85-acd1da21fce0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.757462 Aug 24 11:25:07.020754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 40/83] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:06 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:07.159952 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4ab1d787-0462-4ce9-9247-27841ef9513b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:07.161702 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4ab1d787-0462-4ce9-9247-27841ef9513b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:07.173863 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ab1d787-0462-4ce9-9247-27841ef9513b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:07.174393 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ab1d787-0462-4ce9-9247-27841ef9513b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:07.174812 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ab1d787-0462-4ce9-9247-27841ef9513b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:07.176694 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ab1d787-0462-4ce9-9247-27841ef9513b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:07.183954 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ab1d787-0462-4ce9-9247-27841ef9513b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:07.184514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ab1d787-0462-4ce9-9247-27841ef9513b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:07.601676 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=4 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:07.799053 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4ab1d787-0462-4ce9-9247-27841ef9513b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:07.812435 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4ab1d787-0462-4ce9-9247-27841ef9513b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.654623 Aug 24 11:25:07.813305 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 44/84] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:07 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:07.886038 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a924c391-93dc-46c1-b2c5-9a56ee37e435 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:07.886772 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a924c391-93dc-46c1-b2c5-9a56ee37e435 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:07.898285 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a924c391-93dc-46c1-b2c5-9a56ee37e435 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:07.899103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a924c391-93dc-46c1-b2c5-9a56ee37e435 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:07.899761 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a924c391-93dc-46c1-b2c5-9a56ee37e435 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:07.901069 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a924c391-93dc-46c1-b2c5-9a56ee37e435 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:07.901744 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a924c391-93dc-46c1-b2c5-9a56ee37e435 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:07.902391 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a924c391-93dc-46c1-b2c5-9a56ee37e435 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:08.035608 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-6b757c71-7135-42c5-9937-155f90eca180 req-090a664a-127d-4d57-bb77-eec04e55b24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8d34929-a94c-4766-bb73-021bd01bee81", "tag": "aa887e7f-0e13-4b24-886e-ce7c3e4adc93"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:08.070268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-6b757c71-7135-42c5-9937-155f90eca180 req-090a664a-127d-4d57-bb77-eec04e55b24a service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:08.070870 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-6b757c71-7135-42c5-9937-155f90eca180 req-090a664a-127d-4d57-bb77-eec04e55b24a service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:08.071485 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-6b757c71-7135-42c5-9937-155f90eca180 req-090a664a-127d-4d57-bb77-eec04e55b24a service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:08.145056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-6b757c71-7135-42c5-9937-155f90eca180 req-090a664a-127d-4d57-bb77-eec04e55b24a service nova] Creating event network-changed:aa887e7f-0e13-4b24-886e-ce7c3e4adc93 for instance b8d34929-a94c-4766-bb73-021bd01bee81 on hv-cinder-85427 Aug 24 11:25:08.147663 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-6b757c71-7135-42c5-9937-155f90eca180 req-090a664a-127d-4d57-bb77-eec04e55b24a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121222) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 11:25:08.148256 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-6b757c71-7135-42c5-9937-155f90eca180 req-090a664a-127d-4d57-bb77-eec04e55b24a service nova] Acquired lock "compute-rpcapi-router" {{(pid=121222) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 11:25:08.151314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-032b0e7c-71df-447c-b2cc-ddc579c5222c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:08.151314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-032b0e7c-71df-447c-b2cc-ddc579c5222c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:08.152428 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-032b0e7c-71df-447c-b2cc-ddc579c5222c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:08.156664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-032b0e7c-71df-447c-b2cc-ddc579c5222c None None] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:08.157397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-032b0e7c-71df-447c-b2cc-ddc579c5222c None None] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:08.158025 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-032b0e7c-71df-447c-b2cc-ddc579c5222c None None] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:08.191086 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.compute.rpcapi [None req-032b0e7c-71df-447c-b2cc-ddc579c5222c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 11:25:08.193587 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-032b0e7c-71df-447c-b2cc-ddc579c5222c None None] Releasing lock "compute-rpcapi-router" {{(pid=121222) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 11:25:08.254109 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-032b0e7c-71df-447c-b2cc-ddc579c5222c None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.687488 Aug 24 11:25:08.257447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 41/85] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:25:08.285569 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e817f38c-bb88-420e-b4cc-b4a75227ce0b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:08.287827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e817f38c-bb88-420e-b4cc-b4a75227ce0b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:08.307117 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e817f38c-bb88-420e-b4cc-b4a75227ce0b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:08.307632 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e817f38c-bb88-420e-b4cc-b4a75227ce0b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:08.308917 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e817f38c-bb88-420e-b4cc-b4a75227ce0b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:08.312328 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e817f38c-bb88-420e-b4cc-b4a75227ce0b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:08.313161 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e817f38c-bb88-420e-b4cc-b4a75227ce0b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:08.313822 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e817f38c-bb88-420e-b4cc-b4a75227ce0b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:08.928881 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a924c391-93dc-46c1-b2c5-9a56ee37e435 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:08.946897 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a924c391-93dc-46c1-b2c5-9a56ee37e435 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 1.065574 Aug 24 11:25:08.953852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 45/86] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:07 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:09.011514 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e817f38c-bb88-420e-b4cc-b4a75227ce0b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:09.028121 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e817f38c-bb88-420e-b4cc-b4a75227ce0b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.767254 Aug 24 11:25:09.035399 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 42/87] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:08 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:09.043941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1d22792b-0b16-436b-879d-f8f1dae2d8fb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:09.048875 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1d22792b-0b16-436b-879d-f8f1dae2d8fb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:09.067567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d22792b-0b16-436b-879d-f8f1dae2d8fb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:09.071810 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d22792b-0b16-436b-879d-f8f1dae2d8fb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:09.071810 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d22792b-0b16-436b-879d-f8f1dae2d8fb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:09.071810 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d22792b-0b16-436b-879d-f8f1dae2d8fb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:09.071810 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d22792b-0b16-436b-879d-f8f1dae2d8fb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:09.072488 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d22792b-0b16-436b-879d-f8f1dae2d8fb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:09.376807 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-fba89d75-d7d4-4f78-ac1a-d11c9f07bba3 req-5a52573f-7455-4682-800b-f7e1d4be4cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b611366f-7de9-4b85-8464-8a9b8aaed0c5", "tag": "6c35b179-c77c-456f-b02c-0af67673cd94"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:09.390879 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-fba89d75-d7d4-4f78-ac1a-d11c9f07bba3 req-5a52573f-7455-4682-800b-f7e1d4be4cdc service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:09.391330 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-fba89d75-d7d4-4f78-ac1a-d11c9f07bba3 req-5a52573f-7455-4682-800b-f7e1d4be4cdc service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:09.391751 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-fba89d75-d7d4-4f78-ac1a-d11c9f07bba3 req-5a52573f-7455-4682-800b-f7e1d4be4cdc service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:09.418979 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-fba89d75-d7d4-4f78-ac1a-d11c9f07bba3 req-5a52573f-7455-4682-800b-f7e1d4be4cdc service nova] Creating event network-changed:6c35b179-c77c-456f-b02c-0af67673cd94 for instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 on hv-cinder-85427 Aug 24 11:25:09.418979 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-fba89d75-d7d4-4f78-ac1a-d11c9f07bba3 req-5a52573f-7455-4682-800b-f7e1d4be4cdc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121221) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 11:25:09.423639 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-fba89d75-d7d4-4f78-ac1a-d11c9f07bba3 req-5a52573f-7455-4682-800b-f7e1d4be4cdc service nova] Acquired lock "compute-rpcapi-router" {{(pid=121221) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 11:25:09.424958 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9767dc5f-3e5c-47c1-8e57-38f509d735df None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:09.425632 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9767dc5f-3e5c-47c1-8e57-38f509d735df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:09.426228 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9767dc5f-3e5c-47c1-8e57-38f509d735df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:09.427100 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9767dc5f-3e5c-47c1-8e57-38f509d735df None None] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:09.427716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9767dc5f-3e5c-47c1-8e57-38f509d735df None None] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:09.428455 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9767dc5f-3e5c-47c1-8e57-38f509d735df None None] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:09.443945 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.compute.rpcapi [None req-9767dc5f-3e5c-47c1-8e57-38f509d735df None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 11:25:09.444851 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9767dc5f-3e5c-47c1-8e57-38f509d735df None None] Releasing lock "compute-rpcapi-router" {{(pid=121221) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 11:25:09.466205 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9767dc5f-3e5c-47c1-8e57-38f509d735df None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.510305 Aug 24 11:25:09.466813 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 46/88] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:09.505548 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1d22792b-0b16-436b-879d-f8f1dae2d8fb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:09.525636 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1d22792b-0b16-436b-879d-f8f1dae2d8fb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.488398 Aug 24 11:25:09.542236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 43/89] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:09 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:09.974025 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6f016d66-b54c-490a-9120-ee7f3f38ba97 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:09.980644 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6f016d66-b54c-490a-9120-ee7f3f38ba97 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:09.999831 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f016d66-b54c-490a-9120-ee7f3f38ba97 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:10.000387 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f016d66-b54c-490a-9120-ee7f3f38ba97 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:10.003664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f016d66-b54c-490a-9120-ee7f3f38ba97 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:10.004684 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f016d66-b54c-490a-9120-ee7f3f38ba97 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:10.006840 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f016d66-b54c-490a-9120-ee7f3f38ba97 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:10.007279 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f016d66-b54c-490a-9120-ee7f3f38ba97 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:10.054423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0db0529b-5154-4944-9754-0ab38abd6c14 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:10.054423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0db0529b-5154-4944-9754-0ab38abd6c14 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:10.067208 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=14 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:10.069278 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0db0529b-5154-4944-9754-0ab38abd6c14 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:10.069942 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0db0529b-5154-4944-9754-0ab38abd6c14 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:10.070521 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0db0529b-5154-4944-9754-0ab38abd6c14 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:10.071375 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0db0529b-5154-4944-9754-0ab38abd6c14 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:10.071963 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0db0529b-5154-4944-9754-0ab38abd6c14 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:10.072532 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0db0529b-5154-4944-9754-0ab38abd6c14 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:10.282751 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6f016d66-b54c-490a-9120-ee7f3f38ba97 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:10.299448 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6f016d66-b54c-490a-9120-ee7f3f38ba97 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.328331 Aug 24 11:25:10.300962 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 47/90] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:09 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:10.314618 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-bd38e052-3d3b-48c8-bd7a-eaf480c53508 req-7a66e3c4-65b2-4e74-99f1-4bdedec26805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "855ac5ba-541c-4dc9-8a34-122679948e06", "tag": "8a3e4fbb-fe41-4624-9e7f-cbd92817419e"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:10.350245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-bd38e052-3d3b-48c8-bd7a-eaf480c53508 req-7a66e3c4-65b2-4e74-99f1-4bdedec26805 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:10.350987 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-bd38e052-3d3b-48c8-bd7a-eaf480c53508 req-7a66e3c4-65b2-4e74-99f1-4bdedec26805 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:10.351569 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-bd38e052-3d3b-48c8-bd7a-eaf480c53508 req-7a66e3c4-65b2-4e74-99f1-4bdedec26805 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:10.357290 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0db0529b-5154-4944-9754-0ab38abd6c14 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:10.375141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0db0529b-5154-4944-9754-0ab38abd6c14 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.318100 Aug 24 11:25:10.379667 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 44/91] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:10 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:10.385675 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-bd38e052-3d3b-48c8-bd7a-eaf480c53508 req-7a66e3c4-65b2-4e74-99f1-4bdedec26805 service nova] Creating event network-changed:8a3e4fbb-fe41-4624-9e7f-cbd92817419e for instance 855ac5ba-541c-4dc9-8a34-122679948e06 on hv-cinder-85427 Aug 24 11:25:10.399245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-bd38e052-3d3b-48c8-bd7a-eaf480c53508 req-7a66e3c4-65b2-4e74-99f1-4bdedec26805 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095474 Aug 24 11:25:10.402409 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 48/92] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:10.567750 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-36059188-c1c3-49a2-a1a9-bc02cf4879ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:10.568366 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-36059188-c1c3-49a2-a1a9-bc02cf4879ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:10.579833 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36059188-c1c3-49a2-a1a9-bc02cf4879ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:10.581468 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36059188-c1c3-49a2-a1a9-bc02cf4879ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:10.583200 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36059188-c1c3-49a2-a1a9-bc02cf4879ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:10.585654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36059188-c1c3-49a2-a1a9-bc02cf4879ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:10.585654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36059188-c1c3-49a2-a1a9-bc02cf4879ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:10.586416 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36059188-c1c3-49a2-a1a9-bc02cf4879ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:10.736928 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-36059188-c1c3-49a2-a1a9-bc02cf4879ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:10.747785 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-36059188-c1c3-49a2-a1a9-bc02cf4879ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.183112 Aug 24 11:25:10.747785 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 45/93] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:10 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:11.325157 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ca8401ea-c6bb-41d8-b5ab-dc8221482433 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:11.326630 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ca8401ea-c6bb-41d8-b5ab-dc8221482433 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:11.330024 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=24 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:11.335815 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca8401ea-c6bb-41d8-b5ab-dc8221482433 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:11.336302 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca8401ea-c6bb-41d8-b5ab-dc8221482433 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:11.336730 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca8401ea-c6bb-41d8-b5ab-dc8221482433 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:11.337422 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca8401ea-c6bb-41d8-b5ab-dc8221482433 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:11.337863 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca8401ea-c6bb-41d8-b5ab-dc8221482433 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:11.349214 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca8401ea-c6bb-41d8-b5ab-dc8221482433 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:11.418480 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-794af968-e968-4d2f-a283-e0ed59839bba tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:11.419708 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-794af968-e968-4d2f-a283-e0ed59839bba tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:11.427817 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-794af968-e968-4d2f-a283-e0ed59839bba tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:11.428524 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-794af968-e968-4d2f-a283-e0ed59839bba tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:11.429225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-794af968-e968-4d2f-a283-e0ed59839bba tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:11.430430 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-794af968-e968-4d2f-a283-e0ed59839bba tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:11.432312 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-794af968-e968-4d2f-a283-e0ed59839bba tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:11.432900 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-794af968-e968-4d2f-a283-e0ed59839bba tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:11.486694 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ca8401ea-c6bb-41d8-b5ab-dc8221482433 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:11.490120 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:11.494785 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ca8401ea-c6bb-41d8-b5ab-dc8221482433 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.174032 Aug 24 11:25:11.495669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 49/94] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:11 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:11.574046 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-794af968-e968-4d2f-a283-e0ed59839bba tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:11.582493 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-794af968-e968-4d2f-a283-e0ed59839bba tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.170214 Aug 24 11:25:11.583086 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 46/95] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:11 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:11.775614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2864360d-a43a-44fe-83c4-898df82cce24 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:11.776423 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2864360d-a43a-44fe-83c4-898df82cce24 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:11.784846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2864360d-a43a-44fe-83c4-898df82cce24 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:11.785898 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2864360d-a43a-44fe-83c4-898df82cce24 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:11.786911 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2864360d-a43a-44fe-83c4-898df82cce24 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:11.788488 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2864360d-a43a-44fe-83c4-898df82cce24 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:11.789331 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2864360d-a43a-44fe-83c4-898df82cce24 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:11.789767 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2864360d-a43a-44fe-83c4-898df82cce24 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:11.924792 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2864360d-a43a-44fe-83c4-898df82cce24 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:11.932463 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2864360d-a43a-44fe-83c4-898df82cce24 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.164506 Aug 24 11:25:11.933024 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 50/96] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:11 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:12.518135 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a981439a-7f62-40f1-bd92-8812ff93dd63 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:12.519862 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a981439a-7f62-40f1-bd92-8812ff93dd63 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:12.529857 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a981439a-7f62-40f1-bd92-8812ff93dd63 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:12.529857 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a981439a-7f62-40f1-bd92-8812ff93dd63 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:12.529857 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a981439a-7f62-40f1-bd92-8812ff93dd63 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:12.530167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a981439a-7f62-40f1-bd92-8812ff93dd63 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:12.530495 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a981439a-7f62-40f1-bd92-8812ff93dd63 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:12.530927 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a981439a-7f62-40f1-bd92-8812ff93dd63 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:12.604810 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2d8aebc1-4440-445a-9f37-90ee24d17684 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:12.605551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2d8aebc1-4440-445a-9f37-90ee24d17684 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:12.609965 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:12.614758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d8aebc1-4440-445a-9f37-90ee24d17684 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:12.615253 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d8aebc1-4440-445a-9f37-90ee24d17684 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:12.615693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d8aebc1-4440-445a-9f37-90ee24d17684 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:12.617391 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d8aebc1-4440-445a-9f37-90ee24d17684 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:12.617391 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d8aebc1-4440-445a-9f37-90ee24d17684 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:12.617391 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d8aebc1-4440-445a-9f37-90ee24d17684 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:12.728427 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a981439a-7f62-40f1-bd92-8812ff93dd63 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:12.737829 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a981439a-7f62-40f1-bd92-8812ff93dd63 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.225830 Aug 24 11:25:12.744430 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 47/97] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:12 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:12.783533 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2d8aebc1-4440-445a-9f37-90ee24d17684 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:12.792235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2d8aebc1-4440-445a-9f37-90ee24d17684 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.192553 Aug 24 11:25:12.793028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 51/98] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:12 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:12.952740 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5f972da4-195d-4c73-9cc2-81142149e994 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:12.953393 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5f972da4-195d-4c73-9cc2-81142149e994 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:12.967442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f972da4-195d-4c73-9cc2-81142149e994 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:12.968052 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f972da4-195d-4c73-9cc2-81142149e994 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:12.968413 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f972da4-195d-4c73-9cc2-81142149e994 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:12.969122 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f972da4-195d-4c73-9cc2-81142149e994 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:12.969579 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f972da4-195d-4c73-9cc2-81142149e994 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:12.970028 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f972da4-195d-4c73-9cc2-81142149e994 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:13.137603 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5f972da4-195d-4c73-9cc2-81142149e994 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:13.145427 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5f972da4-195d-4c73-9cc2-81142149e994 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.196724 Aug 24 11:25:13.146025 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 48/99] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:12 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:13.759213 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5ae9fff0-8fc9-4167-8149-ee1f5dffff50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:13.761340 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5ae9fff0-8fc9-4167-8149-ee1f5dffff50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:13.768464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ae9fff0-8fc9-4167-8149-ee1f5dffff50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:13.776994 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ae9fff0-8fc9-4167-8149-ee1f5dffff50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:13.776994 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ae9fff0-8fc9-4167-8149-ee1f5dffff50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:13.776994 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ae9fff0-8fc9-4167-8149-ee1f5dffff50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:13.776994 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ae9fff0-8fc9-4167-8149-ee1f5dffff50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:13.777313 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ae9fff0-8fc9-4167-8149-ee1f5dffff50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:13.821151 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a7502fa2-2886-4cbc-9621-49760288c3b4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:13.821683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a7502fa2-2886-4cbc-9621-49760288c3b4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:13.828476 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7502fa2-2886-4cbc-9621-49760288c3b4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:13.828968 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7502fa2-2886-4cbc-9621-49760288c3b4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:13.829401 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7502fa2-2886-4cbc-9621-49760288c3b4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:13.830121 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7502fa2-2886-4cbc-9621-49760288c3b4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:13.830631 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7502fa2-2886-4cbc-9621-49760288c3b4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:13.831050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7502fa2-2886-4cbc-9621-49760288c3b4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:13.953918 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5ae9fff0-8fc9-4167-8149-ee1f5dffff50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:13.962022 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5ae9fff0-8fc9-4167-8149-ee1f5dffff50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.206603 Aug 24 11:25:13.962609 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 52/100] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:13 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:14.042220 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a7502fa2-2886-4cbc-9621-49760288c3b4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:14.051659 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a7502fa2-2886-4cbc-9621-49760288c3b4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.233884 Aug 24 11:25:14.051802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 49/101] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:13 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:14.173818 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b294912d-9561-4b4b-a629-9b87320c06ef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:14.174648 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b294912d-9561-4b4b-a629-9b87320c06ef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:14.182645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b294912d-9561-4b4b-a629-9b87320c06ef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:14.183402 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b294912d-9561-4b4b-a629-9b87320c06ef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:14.184488 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b294912d-9561-4b4b-a629-9b87320c06ef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:14.184972 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b294912d-9561-4b4b-a629-9b87320c06ef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:14.186448 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b294912d-9561-4b4b-a629-9b87320c06ef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:14.187179 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b294912d-9561-4b4b-a629-9b87320c06ef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:14.376370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b294912d-9561-4b4b-a629-9b87320c06ef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:14.384996 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b294912d-9561-4b4b-a629-9b87320c06ef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.217790 Aug 24 11:25:14.397488 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 53/102] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:14 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:14.983385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0c13c09b-3299-4e1a-b475-0bfa280244d8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:14.984579 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0c13c09b-3299-4e1a-b475-0bfa280244d8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:15.003102 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c13c09b-3299-4e1a-b475-0bfa280244d8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:15.003784 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c13c09b-3299-4e1a-b475-0bfa280244d8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:15.005077 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c13c09b-3299-4e1a-b475-0bfa280244d8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:15.008192 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c13c09b-3299-4e1a-b475-0bfa280244d8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:15.009899 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c13c09b-3299-4e1a-b475-0bfa280244d8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:15.010941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c13c09b-3299-4e1a-b475-0bfa280244d8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:15.083558 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4869bf41-7cf6-4b73-bab4-24d882559bb4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:15.084980 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4869bf41-7cf6-4b73-bab4-24d882559bb4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:15.091408 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4869bf41-7cf6-4b73-bab4-24d882559bb4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:15.091926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4869bf41-7cf6-4b73-bab4-24d882559bb4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:15.092527 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4869bf41-7cf6-4b73-bab4-24d882559bb4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:15.093242 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4869bf41-7cf6-4b73-bab4-24d882559bb4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:15.093885 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4869bf41-7cf6-4b73-bab4-24d882559bb4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:15.094475 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4869bf41-7cf6-4b73-bab4-24d882559bb4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:15.217961 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0c13c09b-3299-4e1a-b475-0bfa280244d8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:15.226082 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0c13c09b-3299-4e1a-b475-0bfa280244d8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.247001 Aug 24 11:25:15.226645 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 50/103] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:14 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:15.252631 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4869bf41-7cf6-4b73-bab4-24d882559bb4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:15.260370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4869bf41-7cf6-4b73-bab4-24d882559bb4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.180920 Aug 24 11:25:15.260941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 54/104] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:15 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:15.407883 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b19d5a52-b16b-48a3-af99-71c033d9f80d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:15.408499 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b19d5a52-b16b-48a3-af99-71c033d9f80d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:15.417321 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b19d5a52-b16b-48a3-af99-71c033d9f80d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:15.418177 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b19d5a52-b16b-48a3-af99-71c033d9f80d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:15.418613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b19d5a52-b16b-48a3-af99-71c033d9f80d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:15.419678 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b19d5a52-b16b-48a3-af99-71c033d9f80d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:15.420181 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b19d5a52-b16b-48a3-af99-71c033d9f80d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:15.421128 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b19d5a52-b16b-48a3-af99-71c033d9f80d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:15.675634 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b19d5a52-b16b-48a3-af99-71c033d9f80d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:15.686759 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b19d5a52-b16b-48a3-af99-71c033d9f80d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.280236 Aug 24 11:25:15.690383 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 51/105] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:15 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:16.259071 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c28bf92e-d288-4301-b0bc-9bfd92e37665 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:16.265090 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c28bf92e-d288-4301-b0bc-9bfd92e37665 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:16.286754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2dfc67ef-b82e-4033-8bdc-b0737c5378de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:16.288059 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-2dfc67ef-b82e-4033-8bdc-b0737c5378de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:16.301861 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2dfc67ef-b82e-4033-8bdc-b0737c5378de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:16.304220 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c28bf92e-d288-4301-b0bc-9bfd92e37665 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:16.304491 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c28bf92e-d288-4301-b0bc-9bfd92e37665 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:16.304919 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c28bf92e-d288-4301-b0bc-9bfd92e37665 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:16.305611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c28bf92e-d288-4301-b0bc-9bfd92e37665 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:16.306100 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c28bf92e-d288-4301-b0bc-9bfd92e37665 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:16.308769 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2dfc67ef-b82e-4033-8bdc-b0737c5378de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:16.309225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2dfc67ef-b82e-4033-8bdc-b0737c5378de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:16.312159 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2dfc67ef-b82e-4033-8bdc-b0737c5378de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:16.313238 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2dfc67ef-b82e-4033-8bdc-b0737c5378de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:16.314248 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2dfc67ef-b82e-4033-8bdc-b0737c5378de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:16.315462 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c28bf92e-d288-4301-b0bc-9bfd92e37665 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:16.386563 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=100 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:16.584244 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-2dfc67ef-b82e-4033-8bdc-b0737c5378de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:16.596128 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-2dfc67ef-b82e-4033-8bdc-b0737c5378de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.319196 Aug 24 11:25:16.598996 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 52/106] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:16 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:16.647474 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c28bf92e-d288-4301-b0bc-9bfd92e37665 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:16.657270 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c28bf92e-d288-4301-b0bc-9bfd92e37665 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.409307 Aug 24 11:25:16.658039 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 55/107] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:16 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:16.705214 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0e6a970d-a21b-486a-989b-4e9361bf645d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:16.706829 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0e6a970d-a21b-486a-989b-4e9361bf645d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:16.731642 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0e6a970d-a21b-486a-989b-4e9361bf645d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:16.731642 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0e6a970d-a21b-486a-989b-4e9361bf645d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:16.735567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0e6a970d-a21b-486a-989b-4e9361bf645d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:16.736322 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0e6a970d-a21b-486a-989b-4e9361bf645d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:16.736798 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0e6a970d-a21b-486a-989b-4e9361bf645d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:16.742156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0e6a970d-a21b-486a-989b-4e9361bf645d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:16.978197 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0e6a970d-a21b-486a-989b-4e9361bf645d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:16.996226 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0e6a970d-a21b-486a-989b-4e9361bf645d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.291368 Aug 24 11:25:16.996995 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 53/108] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:16 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:17.642629 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-68623709-11f8-4dd0-ab7f-68020763ee09 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:17.651957 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-68623709-11f8-4dd0-ab7f-68020763ee09 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:17.680363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9b9dec85-a9df-47a8-b9f3-193692f5bc98 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:17.680363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9b9dec85-a9df-47a8-b9f3-193692f5bc98 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:17.695767 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68623709-11f8-4dd0-ab7f-68020763ee09 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:17.698603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68623709-11f8-4dd0-ab7f-68020763ee09 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:17.699104 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68623709-11f8-4dd0-ab7f-68020763ee09 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:17.699874 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68623709-11f8-4dd0-ab7f-68020763ee09 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:17.701260 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68623709-11f8-4dd0-ab7f-68020763ee09 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:17.701808 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68623709-11f8-4dd0-ab7f-68020763ee09 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:17.712311 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b9dec85-a9df-47a8-b9f3-193692f5bc98 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:17.712930 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b9dec85-a9df-47a8-b9f3-193692f5bc98 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:17.714378 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b9dec85-a9df-47a8-b9f3-193692f5bc98 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:17.716421 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b9dec85-a9df-47a8-b9f3-193692f5bc98 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:17.719646 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b9dec85-a9df-47a8-b9f3-193692f5bc98 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:17.720356 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b9dec85-a9df-47a8-b9f3-193692f5bc98 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:17.967663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-68623709-11f8-4dd0-ab7f-68020763ee09 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:17.983079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-68623709-11f8-4dd0-ab7f-68020763ee09 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.364693 Aug 24 11:25:17.990029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 56/109] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:17 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:18.019709 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4ba8f1c6-1b03-469d-a255-455c2578164b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:18.020319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4ba8f1c6-1b03-469d-a255-455c2578164b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:18.040854 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ba8f1c6-1b03-469d-a255-455c2578164b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:18.041405 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ba8f1c6-1b03-469d-a255-455c2578164b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:18.042070 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ba8f1c6-1b03-469d-a255-455c2578164b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:18.043045 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ba8f1c6-1b03-469d-a255-455c2578164b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:18.043508 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ba8f1c6-1b03-469d-a255-455c2578164b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:18.043928 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ba8f1c6-1b03-469d-a255-455c2578164b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:18.185706 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=4 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:18.367628 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9b9dec85-a9df-47a8-b9f3-193692f5bc98 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:18.379097 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9b9dec85-a9df-47a8-b9f3-193692f5bc98 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.704021 Aug 24 11:25:18.383038 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 54/110] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:17 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:18.412843 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4ba8f1c6-1b03-469d-a255-455c2578164b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:18.439408 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4ba8f1c6-1b03-469d-a255-455c2578164b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.423313 Aug 24 11:25:18.441389 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 57/111] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:18 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:19.008151 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f0f321ce-14df-4b02-b384-6348220a6ab0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:19.008903 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f0f321ce-14df-4b02-b384-6348220a6ab0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:19.015142 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f0f321ce-14df-4b02-b384-6348220a6ab0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:19.019354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f0f321ce-14df-4b02-b384-6348220a6ab0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:19.019354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f0f321ce-14df-4b02-b384-6348220a6ab0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:19.019354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f0f321ce-14df-4b02-b384-6348220a6ab0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:19.019354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f0f321ce-14df-4b02-b384-6348220a6ab0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:19.019804 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f0f321ce-14df-4b02-b384-6348220a6ab0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:19.184355 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f0f321ce-14df-4b02-b384-6348220a6ab0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:19.195079 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f0f321ce-14df-4b02-b384-6348220a6ab0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.191568 Aug 24 11:25:19.195823 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 55/112] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:19 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:19.404134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-362576dc-31ad-450c-80ea-7ee4482c110c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:19.404865 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-362576dc-31ad-450c-80ea-7ee4482c110c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:19.412968 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-362576dc-31ad-450c-80ea-7ee4482c110c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:19.413433 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-362576dc-31ad-450c-80ea-7ee4482c110c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:19.414001 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-362576dc-31ad-450c-80ea-7ee4482c110c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:19.414762 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-362576dc-31ad-450c-80ea-7ee4482c110c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:19.415465 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-362576dc-31ad-450c-80ea-7ee4482c110c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:19.416167 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-362576dc-31ad-450c-80ea-7ee4482c110c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:19.442006 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:19.464747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-73676c80-e6e3-427b-9207-cda1fcc348de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:19.465574 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-73676c80-e6e3-427b-9207-cda1fcc348de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:19.472193 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-73676c80-e6e3-427b-9207-cda1fcc348de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:19.472695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-73676c80-e6e3-427b-9207-cda1fcc348de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:19.473303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-73676c80-e6e3-427b-9207-cda1fcc348de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:19.474064 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-73676c80-e6e3-427b-9207-cda1fcc348de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:19.474665 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-73676c80-e6e3-427b-9207-cda1fcc348de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:19.475100 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-73676c80-e6e3-427b-9207-cda1fcc348de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:19.594863 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-362576dc-31ad-450c-80ea-7ee4482c110c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:19.603869 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-362576dc-31ad-450c-80ea-7ee4482c110c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.203738 Aug 24 11:25:19.604668 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 58/113] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:19 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:19.634725 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-73676c80-e6e3-427b-9207-cda1fcc348de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:19.643168 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-73676c80-e6e3-427b-9207-cda1fcc348de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.182720 Aug 24 11:25:19.643988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 56/114] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:19 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:20.220896 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-51424e91-719e-49a9-88de-61c4543368c8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:20.221835 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-51424e91-719e-49a9-88de-61c4543368c8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:20.244411 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51424e91-719e-49a9-88de-61c4543368c8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:20.245077 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51424e91-719e-49a9-88de-61c4543368c8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:20.246347 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51424e91-719e-49a9-88de-61c4543368c8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:20.251593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51424e91-719e-49a9-88de-61c4543368c8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:20.252260 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51424e91-719e-49a9-88de-61c4543368c8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:20.252972 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51424e91-719e-49a9-88de-61c4543368c8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:20.474273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-51424e91-719e-49a9-88de-61c4543368c8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:20.482501 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-51424e91-719e-49a9-88de-61c4543368c8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.265611 Aug 24 11:25:20.484503 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 59/115] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:20 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:20.629143 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-cbdccde0-0fa0-4b68-a9e8-226719ebe6e8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:20.629143 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-cbdccde0-0fa0-4b68-a9e8-226719ebe6e8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:20.634254 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cbdccde0-0fa0-4b68-a9e8-226719ebe6e8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:20.634835 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cbdccde0-0fa0-4b68-a9e8-226719ebe6e8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:20.635459 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cbdccde0-0fa0-4b68-a9e8-226719ebe6e8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:20.636151 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cbdccde0-0fa0-4b68-a9e8-226719ebe6e8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:20.636599 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cbdccde0-0fa0-4b68-a9e8-226719ebe6e8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:20.637014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cbdccde0-0fa0-4b68-a9e8-226719ebe6e8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:20.665471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7ace9a6a-83cd-48fc-bce5-581b7aa2a405 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:20.666158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7ace9a6a-83cd-48fc-bce5-581b7aa2a405 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:20.672142 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ace9a6a-83cd-48fc-bce5-581b7aa2a405 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:20.672624 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ace9a6a-83cd-48fc-bce5-581b7aa2a405 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:20.673219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ace9a6a-83cd-48fc-bce5-581b7aa2a405 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:20.675683 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ace9a6a-83cd-48fc-bce5-581b7aa2a405 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:20.675683 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ace9a6a-83cd-48fc-bce5-581b7aa2a405 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:20.675683 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ace9a6a-83cd-48fc-bce5-581b7aa2a405 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:20.808323 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-cbdccde0-0fa0-4b68-a9e8-226719ebe6e8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:20.819225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-cbdccde0-0fa0-4b68-a9e8-226719ebe6e8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.197585 Aug 24 11:25:20.819831 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 57/116] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:20 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:20.836100 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7ace9a6a-83cd-48fc-bce5-581b7aa2a405 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:20.845930 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7ace9a6a-83cd-48fc-bce5-581b7aa2a405 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.185160 Aug 24 11:25:20.846695 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 60/117] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:20 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:21.504511 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e6500c74-b335-4d7e-b86c-fa351dfa7417 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:21.505141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e6500c74-b335-4d7e-b86c-fa351dfa7417 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:21.507231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:21.517391 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e6500c74-b335-4d7e-b86c-fa351dfa7417 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:21.517913 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e6500c74-b335-4d7e-b86c-fa351dfa7417 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:21.542050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e6500c74-b335-4d7e-b86c-fa351dfa7417 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:21.543937 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e6500c74-b335-4d7e-b86c-fa351dfa7417 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:21.544437 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e6500c74-b335-4d7e-b86c-fa351dfa7417 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:21.544879 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e6500c74-b335-4d7e-b86c-fa351dfa7417 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:21.814093 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e6500c74-b335-4d7e-b86c-fa351dfa7417 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:21.824199 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e6500c74-b335-4d7e-b86c-fa351dfa7417 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.323673 Aug 24 11:25:21.825045 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 58/118] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:21 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:21.842067 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5b622bc5-187c-4b80-8994-dcc3045213e9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:21.842773 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5b622bc5-187c-4b80-8994-dcc3045213e9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:21.853482 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b622bc5-187c-4b80-8994-dcc3045213e9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:21.854107 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b622bc5-187c-4b80-8994-dcc3045213e9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:21.854616 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b622bc5-187c-4b80-8994-dcc3045213e9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:21.855320 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b622bc5-187c-4b80-8994-dcc3045213e9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:21.855773 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b622bc5-187c-4b80-8994-dcc3045213e9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:21.856351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b622bc5-187c-4b80-8994-dcc3045213e9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:21.867519 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-fbcd047b-0691-46e5-ac8d-e076414f7cfa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:21.868133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-fbcd047b-0691-46e5-ac8d-e076414f7cfa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:21.878464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fbcd047b-0691-46e5-ac8d-e076414f7cfa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:21.878860 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fbcd047b-0691-46e5-ac8d-e076414f7cfa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:21.879466 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fbcd047b-0691-46e5-ac8d-e076414f7cfa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:21.880383 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fbcd047b-0691-46e5-ac8d-e076414f7cfa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:21.880837 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fbcd047b-0691-46e5-ac8d-e076414f7cfa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:21.881263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fbcd047b-0691-46e5-ac8d-e076414f7cfa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:22.085354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-fbcd047b-0691-46e5-ac8d-e076414f7cfa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:22.089326 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5b622bc5-187c-4b80-8994-dcc3045213e9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:22.096766 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-fbcd047b-0691-46e5-ac8d-e076414f7cfa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.232745 Aug 24 11:25:22.099428 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5b622bc5-187c-4b80-8994-dcc3045213e9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.261965 Aug 24 11:25:22.107108 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 59/119] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:21 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:22.114955 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 61/120] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:21 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:22.845620 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-198cead1-0b82-408c-ab31-632d9734ddaf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:22.846401 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-198cead1-0b82-408c-ab31-632d9734ddaf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:22.853430 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-198cead1-0b82-408c-ab31-632d9734ddaf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:22.858536 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-198cead1-0b82-408c-ab31-632d9734ddaf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:22.860658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-198cead1-0b82-408c-ab31-632d9734ddaf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:22.860658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-198cead1-0b82-408c-ab31-632d9734ddaf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:22.861091 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-198cead1-0b82-408c-ab31-632d9734ddaf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:22.861738 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-198cead1-0b82-408c-ab31-632d9734ddaf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:23.024297 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-198cead1-0b82-408c-ab31-632d9734ddaf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:23.033209 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-198cead1-0b82-408c-ab31-632d9734ddaf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.191624 Aug 24 11:25:23.033798 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 60/121] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:22 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:23.118401 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b87c09b7-de1f-46a0-98f2-b90819fba7f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:23.118999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b87c09b7-de1f-46a0-98f2-b90819fba7f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:23.122601 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-627d2288-62ff-4568-9689-47093a24b12a tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:23.124602 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-627d2288-62ff-4568-9689-47093a24b12a tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:23.129366 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b87c09b7-de1f-46a0-98f2-b90819fba7f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:23.129857 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b87c09b7-de1f-46a0-98f2-b90819fba7f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:23.130652 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b87c09b7-de1f-46a0-98f2-b90819fba7f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:23.131031 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b87c09b7-de1f-46a0-98f2-b90819fba7f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:23.131483 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b87c09b7-de1f-46a0-98f2-b90819fba7f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:23.131902 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b87c09b7-de1f-46a0-98f2-b90819fba7f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:23.132800 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-627d2288-62ff-4568-9689-47093a24b12a tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:23.133534 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-627d2288-62ff-4568-9689-47093a24b12a tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:23.135688 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-627d2288-62ff-4568-9689-47093a24b12a tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:23.137917 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-627d2288-62ff-4568-9689-47093a24b12a tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:23.138711 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-627d2288-62ff-4568-9689-47093a24b12a tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:23.139553 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-627d2288-62ff-4568-9689-47093a24b12a tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:23.287272 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b87c09b7-de1f-46a0-98f2-b90819fba7f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:23.293976 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-627d2288-62ff-4568-9689-47093a24b12a tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:23.295703 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b87c09b7-de1f-46a0-98f2-b90819fba7f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.181108 Aug 24 11:25:23.296252 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 62/122] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:23 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:23.301756 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-627d2288-62ff-4568-9689-47093a24b12a tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.184781 Aug 24 11:25:23.302351 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 61/123] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:23 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:24.055692 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4819aaac-eceb-473a-b944-839f200eee5a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:24.056356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4819aaac-eceb-473a-b944-839f200eee5a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:24.066220 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4819aaac-eceb-473a-b944-839f200eee5a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.067752 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4819aaac-eceb-473a-b944-839f200eee5a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.069499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4819aaac-eceb-473a-b944-839f200eee5a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.071389 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4819aaac-eceb-473a-b944-839f200eee5a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.072170 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4819aaac-eceb-473a-b944-839f200eee5a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.075238 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4819aaac-eceb-473a-b944-839f200eee5a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.219386 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4819aaac-eceb-473a-b944-839f200eee5a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:24.227067 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4819aaac-eceb-473a-b944-839f200eee5a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.176066 Aug 24 11:25:24.227630 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 63/124] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:24 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:24.317858 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-147df26a-5918-40a2-a169-014c6031d57a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:24.319206 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-147df26a-5918-40a2-a169-014c6031d57a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:24.322339 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9f65ca33-af95-4e22-b4b1-2ee8e5c18cc9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:24.323225 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9f65ca33-af95-4e22-b4b1-2ee8e5c18cc9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:24.327460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-147df26a-5918-40a2-a169-014c6031d57a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.328276 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-147df26a-5918-40a2-a169-014c6031d57a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.329154 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-147df26a-5918-40a2-a169-014c6031d57a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.330108 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-147df26a-5918-40a2-a169-014c6031d57a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.330823 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-147df26a-5918-40a2-a169-014c6031d57a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.331814 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-147df26a-5918-40a2-a169-014c6031d57a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.332326 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f65ca33-af95-4e22-b4b1-2ee8e5c18cc9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.333013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f65ca33-af95-4e22-b4b1-2ee8e5c18cc9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.333652 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f65ca33-af95-4e22-b4b1-2ee8e5c18cc9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.334375 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f65ca33-af95-4e22-b4b1-2ee8e5c18cc9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:24.335016 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f65ca33-af95-4e22-b4b1-2ee8e5c18cc9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:24.335794 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f65ca33-af95-4e22-b4b1-2ee8e5c18cc9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:24.491024 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9f65ca33-af95-4e22-b4b1-2ee8e5c18cc9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:24.500312 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9f65ca33-af95-4e22-b4b1-2ee8e5c18cc9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.182498 Aug 24 11:25:24.501266 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 64/125] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:24 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:24.509808 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-147df26a-5918-40a2-a169-014c6031d57a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:24.522184 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-147df26a-5918-40a2-a169-014c6031d57a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.209591 Aug 24 11:25:24.522991 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 62/126] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:24 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:25.247370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5aaa03a0-5d04-46ce-b09f-cc00f3b40ff8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:25.248495 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5aaa03a0-5d04-46ce-b09f-cc00f3b40ff8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:25.258686 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5aaa03a0-5d04-46ce-b09f-cc00f3b40ff8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:25.259113 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5aaa03a0-5d04-46ce-b09f-cc00f3b40ff8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:25.259626 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5aaa03a0-5d04-46ce-b09f-cc00f3b40ff8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:25.260339 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5aaa03a0-5d04-46ce-b09f-cc00f3b40ff8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:25.261683 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5aaa03a0-5d04-46ce-b09f-cc00f3b40ff8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:25.262605 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5aaa03a0-5d04-46ce-b09f-cc00f3b40ff8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:25.455252 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5aaa03a0-5d04-46ce-b09f-cc00f3b40ff8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:25.464398 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5aaa03a0-5d04-46ce-b09f-cc00f3b40ff8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.221019 Aug 24 11:25:25.464985 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 65/127] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:25 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:25.524840 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6f9bdcb4-9062-4bd3-89e9-2e17e560ef8f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:25.526331 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6f9bdcb4-9062-4bd3-89e9-2e17e560ef8f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:25.534680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f9bdcb4-9062-4bd3-89e9-2e17e560ef8f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:25.535400 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f9bdcb4-9062-4bd3-89e9-2e17e560ef8f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:25.536164 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f9bdcb4-9062-4bd3-89e9-2e17e560ef8f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:25.537016 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f9bdcb4-9062-4bd3-89e9-2e17e560ef8f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:25.538193 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f9bdcb4-9062-4bd3-89e9-2e17e560ef8f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:25.538930 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f9bdcb4-9062-4bd3-89e9-2e17e560ef8f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:25.561220 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-369bdc7a-9892-4fc5-81e5-68de41ac17a0 req-02c19aea-9899-418a-a6ca-a7042a260fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d34929-a94c-4766-bb73-021bd01bee81", "name": "network-vif-plugged", "status": "completed", "tag": "aa887e7f-0e13-4b24-886e-ce7c3e4adc93"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:25.565414 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:25.572085 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-369bdc7a-9892-4fc5-81e5-68de41ac17a0 req-02c19aea-9899-418a-a6ca-a7042a260fb3 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:25.572779 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-369bdc7a-9892-4fc5-81e5-68de41ac17a0 req-02c19aea-9899-418a-a6ca-a7042a260fb3 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:25.573409 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-369bdc7a-9892-4fc5-81e5-68de41ac17a0 req-02c19aea-9899-418a-a6ca-a7042a260fb3 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:25.589444 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-369bdc7a-9892-4fc5-81e5-68de41ac17a0 req-02c19aea-9899-418a-a6ca-a7042a260fb3 service nova] Creating event network-vif-plugged:aa887e7f-0e13-4b24-886e-ce7c3e4adc93 for instance b8d34929-a94c-4766-bb73-021bd01bee81 on hv-cinder-85427 Aug 24 11:25:25.597652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-369bdc7a-9892-4fc5-81e5-68de41ac17a0 req-02c19aea-9899-418a-a6ca-a7042a260fb3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.283553 Aug 24 11:25:25.598685 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 63/128] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:25:25.604930 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-65710f69-ab93-4a56-bf36-afb84684cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:25.605642 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-65710f69-ab93-4a56-bf36-afb84684cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:25.612629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-65710f69-ab93-4a56-bf36-afb84684cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:25.613122 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-65710f69-ab93-4a56-bf36-afb84684cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:25.613728 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-65710f69-ab93-4a56-bf36-afb84684cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:25.614471 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-65710f69-ab93-4a56-bf36-afb84684cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:25.614920 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-65710f69-ab93-4a56-bf36-afb84684cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:25.615439 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-65710f69-ab93-4a56-bf36-afb84684cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:25.691209 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6f9bdcb4-9062-4bd3-89e9-2e17e560ef8f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:25.723695 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6f9bdcb4-9062-4bd3-89e9-2e17e560ef8f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.206388 Aug 24 11:25:25.724308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 66/129] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:25 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:25.802062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-65710f69-ab93-4a56-bf36-afb84684cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:25.820484 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-65710f69-ab93-4a56-bf36-afb84684cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.220355 Aug 24 11:25:25.822856 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 64/130] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:25 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:26.484684 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dc035fde-b76a-4073-b490-88de45fe891d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:26.485288 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-dc035fde-b76a-4073-b490-88de45fe891d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:26.491860 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc035fde-b76a-4073-b490-88de45fe891d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:26.492623 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc035fde-b76a-4073-b490-88de45fe891d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:26.493116 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc035fde-b76a-4073-b490-88de45fe891d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:26.493907 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc035fde-b76a-4073-b490-88de45fe891d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:26.494444 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc035fde-b76a-4073-b490-88de45fe891d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:26.494930 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc035fde-b76a-4073-b490-88de45fe891d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:26.643680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dc035fde-b76a-4073-b490-88de45fe891d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:26.651462 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-dc035fde-b76a-4073-b490-88de45fe891d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.170690 Aug 24 11:25:26.652127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 67/131] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:26 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:26.743872 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4402f5f1-ee8d-4f90-a3cb-94be859c5fa7 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:26.745324 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4402f5f1-ee8d-4f90-a3cb-94be859c5fa7 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:26.752208 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4402f5f1-ee8d-4f90-a3cb-94be859c5fa7 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:26.752928 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4402f5f1-ee8d-4f90-a3cb-94be859c5fa7 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:26.753559 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4402f5f1-ee8d-4f90-a3cb-94be859c5fa7 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:26.754476 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4402f5f1-ee8d-4f90-a3cb-94be859c5fa7 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:26.764886 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4402f5f1-ee8d-4f90-a3cb-94be859c5fa7 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:26.764886 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4402f5f1-ee8d-4f90-a3cb-94be859c5fa7 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:26.843217 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ca1e8060-fc77-4c6f-8f8e-2975892c90f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:26.843835 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ca1e8060-fc77-4c6f-8f8e-2975892c90f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:26.850009 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca1e8060-fc77-4c6f-8f8e-2975892c90f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:26.850713 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca1e8060-fc77-4c6f-8f8e-2975892c90f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:26.851141 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca1e8060-fc77-4c6f-8f8e-2975892c90f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:26.852103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca1e8060-fc77-4c6f-8f8e-2975892c90f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:26.852709 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca1e8060-fc77-4c6f-8f8e-2975892c90f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:26.853280 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca1e8060-fc77-4c6f-8f8e-2975892c90f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:26.901796 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4402f5f1-ee8d-4f90-a3cb-94be859c5fa7 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:26.910576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4402f5f1-ee8d-4f90-a3cb-94be859c5fa7 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.170652 Aug 24 11:25:26.911433 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 65/132] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:26 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:26.987160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ca1e8060-fc77-4c6f-8f8e-2975892c90f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:26.994799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ca1e8060-fc77-4c6f-8f8e-2975892c90f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.155899 Aug 24 11:25:26.995374 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 68/133] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:26 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:27.672883 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b7cbe911-f85e-4503-a853-59eb5983f291 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:27.673530 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b7cbe911-f85e-4503-a853-59eb5983f291 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:27.679643 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b7cbe911-f85e-4503-a853-59eb5983f291 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:27.680139 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b7cbe911-f85e-4503-a853-59eb5983f291 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:27.680576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b7cbe911-f85e-4503-a853-59eb5983f291 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:27.681268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b7cbe911-f85e-4503-a853-59eb5983f291 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:27.681721 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b7cbe911-f85e-4503-a853-59eb5983f291 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:27.682170 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b7cbe911-f85e-4503-a853-59eb5983f291 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:27.832894 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b7cbe911-f85e-4503-a853-59eb5983f291 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:27.846371 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b7cbe911-f85e-4503-a853-59eb5983f291 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.173517 Aug 24 11:25:27.846371 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 66/134] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:27 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:27.932515 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c313a348-28e7-4d8b-949c-6b1642f0a728 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:27.933126 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c313a348-28e7-4d8b-949c-6b1642f0a728 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:27.939127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c313a348-28e7-4d8b-949c-6b1642f0a728 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:27.939613 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c313a348-28e7-4d8b-949c-6b1642f0a728 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:27.940048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c313a348-28e7-4d8b-949c-6b1642f0a728 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:27.940737 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c313a348-28e7-4d8b-949c-6b1642f0a728 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:27.941191 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c313a348-28e7-4d8b-949c-6b1642f0a728 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:27.946820 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c313a348-28e7-4d8b-949c-6b1642f0a728 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:28.016527 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-334cec38-30fd-42c6-9b2a-13ab11f44282 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:28.017136 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-334cec38-30fd-42c6-9b2a-13ab11f44282 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:28.023283 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-334cec38-30fd-42c6-9b2a-13ab11f44282 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:28.023666 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-334cec38-30fd-42c6-9b2a-13ab11f44282 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:28.024100 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-334cec38-30fd-42c6-9b2a-13ab11f44282 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:28.024794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-334cec38-30fd-42c6-9b2a-13ab11f44282 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:28.025245 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-334cec38-30fd-42c6-9b2a-13ab11f44282 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:28.025666 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-334cec38-30fd-42c6-9b2a-13ab11f44282 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:28.080985 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c313a348-28e7-4d8b-949c-6b1642f0a728 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:28.088861 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c313a348-28e7-4d8b-949c-6b1642f0a728 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.160172 Aug 24 11:25:28.089438 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 69/135] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:27 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:28.156337 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-334cec38-30fd-42c6-9b2a-13ab11f44282 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:28.164117 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-334cec38-30fd-42c6-9b2a-13ab11f44282 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.152028 Aug 24 11:25:28.164687 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 67/136] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:28 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:28.874204 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-622544ba-f4de-4e09-81bf-a464a72e3d9f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:28.874204 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-622544ba-f4de-4e09-81bf-a464a72e3d9f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:28.874204 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-622544ba-f4de-4e09-81bf-a464a72e3d9f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:28.874204 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-622544ba-f4de-4e09-81bf-a464a72e3d9f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:28.874611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-622544ba-f4de-4e09-81bf-a464a72e3d9f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:28.874611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-622544ba-f4de-4e09-81bf-a464a72e3d9f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:28.874611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-622544ba-f4de-4e09-81bf-a464a72e3d9f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:28.874611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-622544ba-f4de-4e09-81bf-a464a72e3d9f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:29.017718 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-622544ba-f4de-4e09-81bf-a464a72e3d9f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:29.025614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-622544ba-f4de-4e09-81bf-a464a72e3d9f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.166335 Aug 24 11:25:29.026227 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 70/137] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:28 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:29.110051 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-053f3f6c-df6c-4f48-8421-ad156d1607b0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:29.110670 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-053f3f6c-df6c-4f48-8421-ad156d1607b0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:29.116899 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-053f3f6c-df6c-4f48-8421-ad156d1607b0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:29.117385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-053f3f6c-df6c-4f48-8421-ad156d1607b0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:29.117820 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-053f3f6c-df6c-4f48-8421-ad156d1607b0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:29.118530 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-053f3f6c-df6c-4f48-8421-ad156d1607b0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:29.118984 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-053f3f6c-df6c-4f48-8421-ad156d1607b0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:29.119429 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-053f3f6c-df6c-4f48-8421-ad156d1607b0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:29.184729 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c860932c-7b1f-4a5a-9ba1-b21c2120c065 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:29.185333 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c860932c-7b1f-4a5a-9ba1-b21c2120c065 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:29.191873 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c860932c-7b1f-4a5a-9ba1-b21c2120c065 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:29.192353 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c860932c-7b1f-4a5a-9ba1-b21c2120c065 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:29.192782 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c860932c-7b1f-4a5a-9ba1-b21c2120c065 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:29.193466 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c860932c-7b1f-4a5a-9ba1-b21c2120c065 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:29.193931 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c860932c-7b1f-4a5a-9ba1-b21c2120c065 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:29.194349 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c860932c-7b1f-4a5a-9ba1-b21c2120c065 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:29.252027 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-053f3f6c-df6c-4f48-8421-ad156d1607b0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:29.259793 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-053f3f6c-df6c-4f48-8421-ad156d1607b0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.153571 Aug 24 11:25:29.260290 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 68/138] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:29 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:29.326045 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c860932c-7b1f-4a5a-9ba1-b21c2120c065 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:29.333700 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c860932c-7b1f-4a5a-9ba1-b21c2120c065 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.152944 Aug 24 11:25:29.334301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 71/139] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:29 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:30.046532 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c6987258-fad3-4182-84a1-93d3c325aa5e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:30.047197 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c6987258-fad3-4182-84a1-93d3c325aa5e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:30.053340 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6987258-fad3-4182-84a1-93d3c325aa5e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:30.053853 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6987258-fad3-4182-84a1-93d3c325aa5e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:30.054310 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6987258-fad3-4182-84a1-93d3c325aa5e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:30.055129 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6987258-fad3-4182-84a1-93d3c325aa5e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:30.055474 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6987258-fad3-4182-84a1-93d3c325aa5e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:30.055886 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6987258-fad3-4182-84a1-93d3c325aa5e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:30.188301 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c6987258-fad3-4182-84a1-93d3c325aa5e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:30.191898 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=100 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:30.196474 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c6987258-fad3-4182-84a1-93d3c325aa5e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.154106 Aug 24 11:25:30.197053 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 69/140] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:30 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:30.281667 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-67632849-9ed5-4d41-b361-4999b359de31 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:30.282391 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-67632849-9ed5-4d41-b361-4999b359de31 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:30.288761 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-67632849-9ed5-4d41-b361-4999b359de31 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:30.289243 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-67632849-9ed5-4d41-b361-4999b359de31 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:30.289670 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-67632849-9ed5-4d41-b361-4999b359de31 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:30.290650 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-67632849-9ed5-4d41-b361-4999b359de31 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:30.291099 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-67632849-9ed5-4d41-b361-4999b359de31 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:30.291554 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-67632849-9ed5-4d41-b361-4999b359de31 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:30.354437 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c93966c1-b746-4df2-8b9d-8fc48f428137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:30.355048 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c93966c1-b746-4df2-8b9d-8fc48f428137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:30.361546 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c93966c1-b746-4df2-8b9d-8fc48f428137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:30.362067 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c93966c1-b746-4df2-8b9d-8fc48f428137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:30.362503 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c93966c1-b746-4df2-8b9d-8fc48f428137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:30.363199 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c93966c1-b746-4df2-8b9d-8fc48f428137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:30.363654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c93966c1-b746-4df2-8b9d-8fc48f428137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:30.364082 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c93966c1-b746-4df2-8b9d-8fc48f428137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:30.423993 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-67632849-9ed5-4d41-b361-4999b359de31 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:30.431934 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-67632849-9ed5-4d41-b361-4999b359de31 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.155097 Aug 24 11:25:30.432532 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 72/141] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:30 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:30.498757 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c93966c1-b746-4df2-8b9d-8fc48f428137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:30.507062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c93966c1-b746-4df2-8b9d-8fc48f428137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.156812 Aug 24 11:25:30.507643 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 70/142] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:30 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:31.218258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fa3fab3c-f83b-493f-9335-8358d04f226f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:31.218841 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fa3fab3c-f83b-493f-9335-8358d04f226f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:31.224816 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa3fab3c-f83b-493f-9335-8358d04f226f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:31.225305 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa3fab3c-f83b-493f-9335-8358d04f226f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:31.226581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa3fab3c-f83b-493f-9335-8358d04f226f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:31.226581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa3fab3c-f83b-493f-9335-8358d04f226f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:31.227016 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa3fab3c-f83b-493f-9335-8358d04f226f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:31.227436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa3fab3c-f83b-493f-9335-8358d04f226f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:31.360552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fa3fab3c-f83b-493f-9335-8358d04f226f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:31.368583 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fa3fab3c-f83b-493f-9335-8358d04f226f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.154763 Aug 24 11:25:31.369160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 73/143] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:31 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:31.453899 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-38bb57bd-212d-429e-9715-1d094a672bb4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:31.454559 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-38bb57bd-212d-429e-9715-1d094a672bb4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:31.460910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-38bb57bd-212d-429e-9715-1d094a672bb4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:31.461413 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-38bb57bd-212d-429e-9715-1d094a672bb4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:31.461853 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-38bb57bd-212d-429e-9715-1d094a672bb4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:31.462717 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-38bb57bd-212d-429e-9715-1d094a672bb4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:31.463174 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-38bb57bd-212d-429e-9715-1d094a672bb4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:31.463592 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-38bb57bd-212d-429e-9715-1d094a672bb4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:31.527400 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f6908c8b-e7ef-4d00-af7f-f2471041815c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:31.527929 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f6908c8b-e7ef-4d00-af7f-f2471041815c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:31.534153 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f6908c8b-e7ef-4d00-af7f-f2471041815c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:31.534632 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f6908c8b-e7ef-4d00-af7f-f2471041815c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:31.535060 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f6908c8b-e7ef-4d00-af7f-f2471041815c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:31.535739 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f6908c8b-e7ef-4d00-af7f-f2471041815c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:31.536182 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f6908c8b-e7ef-4d00-af7f-f2471041815c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:31.536593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f6908c8b-e7ef-4d00-af7f-f2471041815c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:31.595574 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-38bb57bd-212d-429e-9715-1d094a672bb4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:31.603727 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-38bb57bd-212d-429e-9715-1d094a672bb4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.154314 Aug 24 11:25:31.604316 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 71/144] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:31 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:31.681559 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f6908c8b-e7ef-4d00-af7f-f2471041815c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:31.689854 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f6908c8b-e7ef-4d00-af7f-f2471041815c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.166319 Aug 24 11:25:31.690441 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 74/145] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:31 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:32.389740 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6734aeb3-b7af-4d04-b3b6-f59913813dad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:32.390386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6734aeb3-b7af-4d04-b3b6-f59913813dad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:32.396331 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6734aeb3-b7af-4d04-b3b6-f59913813dad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:32.396816 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6734aeb3-b7af-4d04-b3b6-f59913813dad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:32.397252 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6734aeb3-b7af-4d04-b3b6-f59913813dad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:32.397962 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6734aeb3-b7af-4d04-b3b6-f59913813dad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:32.398423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6734aeb3-b7af-4d04-b3b6-f59913813dad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:32.398839 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6734aeb3-b7af-4d04-b3b6-f59913813dad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:32.536189 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6734aeb3-b7af-4d04-b3b6-f59913813dad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:32.544109 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6734aeb3-b7af-4d04-b3b6-f59913813dad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.158281 Aug 24 11:25:32.545206 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 72/146] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:32 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:32.629153 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d20f0144-5427-4aff-b735-fc7b921c5d35 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:32.629756 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d20f0144-5427-4aff-b735-fc7b921c5d35 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:32.635823 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d20f0144-5427-4aff-b735-fc7b921c5d35 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:32.636320 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d20f0144-5427-4aff-b735-fc7b921c5d35 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:32.636736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d20f0144-5427-4aff-b735-fc7b921c5d35 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:32.637410 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d20f0144-5427-4aff-b735-fc7b921c5d35 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:32.637851 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d20f0144-5427-4aff-b735-fc7b921c5d35 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:32.638288 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d20f0144-5427-4aff-b735-fc7b921c5d35 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:32.710304 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-cf7a1aa4-39ca-4935-8773-154a2e286f75 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:32.711245 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-cf7a1aa4-39ca-4935-8773-154a2e286f75 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:32.726175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cf7a1aa4-39ca-4935-8773-154a2e286f75 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:32.728750 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cf7a1aa4-39ca-4935-8773-154a2e286f75 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:32.730281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cf7a1aa4-39ca-4935-8773-154a2e286f75 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:32.733184 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cf7a1aa4-39ca-4935-8773-154a2e286f75 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:32.734741 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cf7a1aa4-39ca-4935-8773-154a2e286f75 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:32.735342 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cf7a1aa4-39ca-4935-8773-154a2e286f75 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:32.805354 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d20f0144-5427-4aff-b735-fc7b921c5d35 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:32.814173 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d20f0144-5427-4aff-b735-fc7b921c5d35 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.188691 Aug 24 11:25:32.827752 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 75/147] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:32 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:25:32.869766 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-d1c862f6-6847-40f1-8c43-49518ea584f1 req-4c502133-3ffb-4fbe-829b-420851936807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b611366f-7de9-4b85-8464-8a9b8aaed0c5", "name": "network-vif-plugged", "status": "completed", "tag": "6c35b179-c77c-456f-b02c-0af67673cd94"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:32.880165 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-d1c862f6-6847-40f1-8c43-49518ea584f1 req-4c502133-3ffb-4fbe-829b-420851936807 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:32.880888 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-d1c862f6-6847-40f1-8c43-49518ea584f1 req-4c502133-3ffb-4fbe-829b-420851936807 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:32.881319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-d1c862f6-6847-40f1-8c43-49518ea584f1 req-4c502133-3ffb-4fbe-829b-420851936807 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:32.894906 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-d1c862f6-6847-40f1-8c43-49518ea584f1 req-4c502133-3ffb-4fbe-829b-420851936807 service nova] Creating event network-vif-plugged:6c35b179-c77c-456f-b02c-0af67673cd94 for instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 on hv-cinder-85427 Aug 24 11:25:32.900272 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-d1c862f6-6847-40f1-8c43-49518ea584f1 req-4c502133-3ffb-4fbe-829b-420851936807 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034645 Aug 24 11:25:32.900965 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 76/148] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:25:33.045661 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-cf7a1aa4-39ca-4935-8773-154a2e286f75 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:33.054614 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-cf7a1aa4-39ca-4935-8773-154a2e286f75 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.348242 Aug 24 11:25:33.055203 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 73/149] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:32 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:33.571680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d298ae2b-672d-452f-9ef8-e02a5caef8e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:33.573146 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d298ae2b-672d-452f-9ef8-e02a5caef8e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:33.582654 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d298ae2b-672d-452f-9ef8-e02a5caef8e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:33.583155 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d298ae2b-672d-452f-9ef8-e02a5caef8e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:33.583665 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d298ae2b-672d-452f-9ef8-e02a5caef8e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:33.587567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d298ae2b-672d-452f-9ef8-e02a5caef8e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:33.588065 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d298ae2b-672d-452f-9ef8-e02a5caef8e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:33.588505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d298ae2b-672d-452f-9ef8-e02a5caef8e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:33.733346 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d298ae2b-672d-452f-9ef8-e02a5caef8e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:33.740946 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d298ae2b-672d-452f-9ef8-e02a5caef8e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.176043 Aug 24 11:25:33.741508 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 77/150] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:33 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:33.835492 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c4f7c22f-037d-4233-b81d-73853eb295bf tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:33.835492 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c4f7c22f-037d-4233-b81d-73853eb295bf tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:33.840943 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c4f7c22f-037d-4233-b81d-73853eb295bf tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:33.841432 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c4f7c22f-037d-4233-b81d-73853eb295bf tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:33.842473 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c4f7c22f-037d-4233-b81d-73853eb295bf tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:33.843164 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c4f7c22f-037d-4233-b81d-73853eb295bf tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:33.843617 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c4f7c22f-037d-4233-b81d-73853eb295bf tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:33.844067 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c4f7c22f-037d-4233-b81d-73853eb295bf tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:33.983960 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c4f7c22f-037d-4233-b81d-73853eb295bf tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:33.991821 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c4f7c22f-037d-4233-b81d-73853eb295bf tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.161585 Aug 24 11:25:33.992494 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 74/151] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:33 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:34.075813 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6ff80ec4-8534-4d3d-bbfa-3d3218772a2b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:34.076374 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6ff80ec4-8534-4d3d-bbfa-3d3218772a2b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:34.082844 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ff80ec4-8534-4d3d-bbfa-3d3218772a2b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:34.083492 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ff80ec4-8534-4d3d-bbfa-3d3218772a2b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:34.084267 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ff80ec4-8534-4d3d-bbfa-3d3218772a2b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:34.085469 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ff80ec4-8534-4d3d-bbfa-3d3218772a2b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:34.086066 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ff80ec4-8534-4d3d-bbfa-3d3218772a2b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:34.086618 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ff80ec4-8534-4d3d-bbfa-3d3218772a2b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:34.265443 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6ff80ec4-8534-4d3d-bbfa-3d3218772a2b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:34.273305 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6ff80ec4-8534-4d3d-bbfa-3d3218772a2b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.201598 Aug 24 11:25:34.273901 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 78/152] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:34 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:34.761771 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-26cf6d58-ee99-4c69-bc3f-3d74d2ab0c58 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:34.762417 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-26cf6d58-ee99-4c69-bc3f-3d74d2ab0c58 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:34.768499 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-26cf6d58-ee99-4c69-bc3f-3d74d2ab0c58 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:34.769008 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-26cf6d58-ee99-4c69-bc3f-3d74d2ab0c58 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:34.769438 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-26cf6d58-ee99-4c69-bc3f-3d74d2ab0c58 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:34.770152 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-26cf6d58-ee99-4c69-bc3f-3d74d2ab0c58 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:34.770606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-26cf6d58-ee99-4c69-bc3f-3d74d2ab0c58 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:34.771023 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-26cf6d58-ee99-4c69-bc3f-3d74d2ab0c58 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:34.898493 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-26cf6d58-ee99-4c69-bc3f-3d74d2ab0c58 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:34.906766 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-26cf6d58-ee99-4c69-bc3f-3d74d2ab0c58 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.148751 Aug 24 11:25:34.907473 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 75/153] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:34 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:35.012972 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-322a8074-158f-45cb-97cf-dcbe2f1b3895 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:35.013685 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-322a8074-158f-45cb-97cf-dcbe2f1b3895 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:35.021038 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-322a8074-158f-45cb-97cf-dcbe2f1b3895 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:35.021038 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-322a8074-158f-45cb-97cf-dcbe2f1b3895 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:35.021038 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-322a8074-158f-45cb-97cf-dcbe2f1b3895 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:35.021306 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-322a8074-158f-45cb-97cf-dcbe2f1b3895 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:35.021759 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-322a8074-158f-45cb-97cf-dcbe2f1b3895 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:35.022213 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-322a8074-158f-45cb-97cf-dcbe2f1b3895 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:35.150297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-322a8074-158f-45cb-97cf-dcbe2f1b3895 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:35.158621 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-322a8074-158f-45cb-97cf-dcbe2f1b3895 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.149539 Aug 24 11:25:35.159125 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 79/154] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:35 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:35.295904 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f32ba30f-01db-48a0-8247-a06584b97a8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:35.297068 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f32ba30f-01db-48a0-8247-a06584b97a8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:35.303299 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f32ba30f-01db-48a0-8247-a06584b97a8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:35.303792 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f32ba30f-01db-48a0-8247-a06584b97a8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:35.304221 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f32ba30f-01db-48a0-8247-a06584b97a8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:35.304959 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f32ba30f-01db-48a0-8247-a06584b97a8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:35.305405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f32ba30f-01db-48a0-8247-a06584b97a8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:35.306388 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f32ba30f-01db-48a0-8247-a06584b97a8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:35.455696 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f32ba30f-01db-48a0-8247-a06584b97a8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:35.463287 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f32ba30f-01db-48a0-8247-a06584b97a8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.171316 Aug 24 11:25:35.463853 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 76/155] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:35 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:35.928685 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ff6ac1a3-78ee-4bd0-829d-e6da3a448d20 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:35.929291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ff6ac1a3-78ee-4bd0-829d-e6da3a448d20 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:35.935359 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ff6ac1a3-78ee-4bd0-829d-e6da3a448d20 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:35.935770 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ff6ac1a3-78ee-4bd0-829d-e6da3a448d20 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:35.936195 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ff6ac1a3-78ee-4bd0-829d-e6da3a448d20 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:35.936872 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ff6ac1a3-78ee-4bd0-829d-e6da3a448d20 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:35.937312 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ff6ac1a3-78ee-4bd0-829d-e6da3a448d20 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:35.937722 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ff6ac1a3-78ee-4bd0-829d-e6da3a448d20 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:36.066334 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ff6ac1a3-78ee-4bd0-829d-e6da3a448d20 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:36.073973 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ff6ac1a3-78ee-4bd0-829d-e6da3a448d20 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.149700 Aug 24 11:25:36.074541 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 80/156] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:35 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:36.179861 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-547abaf5-5b19-45e6-bbd6-5b6b355f76b8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:36.180484 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-547abaf5-5b19-45e6-bbd6-5b6b355f76b8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:36.186582 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-547abaf5-5b19-45e6-bbd6-5b6b355f76b8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:36.187004 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-547abaf5-5b19-45e6-bbd6-5b6b355f76b8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:36.187435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-547abaf5-5b19-45e6-bbd6-5b6b355f76b8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:36.188119 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-547abaf5-5b19-45e6-bbd6-5b6b355f76b8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:36.188570 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-547abaf5-5b19-45e6-bbd6-5b6b355f76b8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:36.188986 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-547abaf5-5b19-45e6-bbd6-5b6b355f76b8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:36.320633 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-547abaf5-5b19-45e6-bbd6-5b6b355f76b8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:36.328999 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-547abaf5-5b19-45e6-bbd6-5b6b355f76b8 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.152958 Aug 24 11:25:36.329574 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 77/157] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:36 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:36.483770 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-73393797-7350-4c84-bd73-f3a119fd9325 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:36.484461 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-73393797-7350-4c84-bd73-f3a119fd9325 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:36.490578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73393797-7350-4c84-bd73-f3a119fd9325 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:36.491052 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73393797-7350-4c84-bd73-f3a119fd9325 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:36.491478 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73393797-7350-4c84-bd73-f3a119fd9325 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:36.492149 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73393797-7350-4c84-bd73-f3a119fd9325 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:36.492674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73393797-7350-4c84-bd73-f3a119fd9325 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:36.493088 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73393797-7350-4c84-bd73-f3a119fd9325 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:36.620933 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-73393797-7350-4c84-bd73-f3a119fd9325 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:36.629285 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-73393797-7350-4c84-bd73-f3a119fd9325 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.149350 Aug 24 11:25:36.629849 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 81/158] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:36 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:37.095885 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5c4a517a-a458-4080-b228-31a5d668981d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:37.096503 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5c4a517a-a458-4080-b228-31a5d668981d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:37.102942 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5c4a517a-a458-4080-b228-31a5d668981d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:37.103437 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5c4a517a-a458-4080-b228-31a5d668981d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:37.103874 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5c4a517a-a458-4080-b228-31a5d668981d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:37.104580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5c4a517a-a458-4080-b228-31a5d668981d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:37.105032 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5c4a517a-a458-4080-b228-31a5d668981d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:37.105453 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5c4a517a-a458-4080-b228-31a5d668981d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:37.235431 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5c4a517a-a458-4080-b228-31a5d668981d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:37.243091 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5c4a517a-a458-4080-b228-31a5d668981d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.151690 Aug 24 11:25:37.243660 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 78/159] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:37 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:37.349785 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-347fcb32-057b-4960-89c6-fd23bc0a6b09 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:37.350437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-347fcb32-057b-4960-89c6-fd23bc0a6b09 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:37.356395 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-347fcb32-057b-4960-89c6-fd23bc0a6b09 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:37.356883 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-347fcb32-057b-4960-89c6-fd23bc0a6b09 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:37.357322 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-347fcb32-057b-4960-89c6-fd23bc0a6b09 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:37.358147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-347fcb32-057b-4960-89c6-fd23bc0a6b09 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:37.358613 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-347fcb32-057b-4960-89c6-fd23bc0a6b09 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:37.359039 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-347fcb32-057b-4960-89c6-fd23bc0a6b09 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:37.494141 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-347fcb32-057b-4960-89c6-fd23bc0a6b09 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:37.505601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-347fcb32-057b-4960-89c6-fd23bc0a6b09 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.159225 Aug 24 11:25:37.506774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 82/160] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:37 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:37.650265 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ca140520-99ef-459a-8a55-82cbd775d9de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:37.650874 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ca140520-99ef-459a-8a55-82cbd775d9de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:37.656808 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ca140520-99ef-459a-8a55-82cbd775d9de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:37.657286 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ca140520-99ef-459a-8a55-82cbd775d9de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:37.657721 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ca140520-99ef-459a-8a55-82cbd775d9de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:37.658421 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ca140520-99ef-459a-8a55-82cbd775d9de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:37.658869 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ca140520-99ef-459a-8a55-82cbd775d9de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:37.659312 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ca140520-99ef-459a-8a55-82cbd775d9de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:37.790696 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ca140520-99ef-459a-8a55-82cbd775d9de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:37.799475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ca140520-99ef-459a-8a55-82cbd775d9de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.152876 Aug 24 11:25:37.800048 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 79/161] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:37 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:38.264651 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d4446b38-eda6-47f1-b0e3-ad192314f998 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:38.265313 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d4446b38-eda6-47f1-b0e3-ad192314f998 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:38.271345 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d4446b38-eda6-47f1-b0e3-ad192314f998 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:38.271821 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d4446b38-eda6-47f1-b0e3-ad192314f998 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:38.272251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d4446b38-eda6-47f1-b0e3-ad192314f998 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:38.272932 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d4446b38-eda6-47f1-b0e3-ad192314f998 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:38.273381 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d4446b38-eda6-47f1-b0e3-ad192314f998 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:38.273793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d4446b38-eda6-47f1-b0e3-ad192314f998 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:38.410572 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d4446b38-eda6-47f1-b0e3-ad192314f998 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:38.414316 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:38.419178 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d4446b38-eda6-47f1-b0e3-ad192314f998 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.158871 Aug 24 11:25:38.419765 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 83/162] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:38 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:38.527743 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-06a34af1-4dba-42c3-b044-adc7f8a2f0fa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:38.528399 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-06a34af1-4dba-42c3-b044-adc7f8a2f0fa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:38.536129 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-06a34af1-4dba-42c3-b044-adc7f8a2f0fa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:38.536622 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-06a34af1-4dba-42c3-b044-adc7f8a2f0fa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:38.537048 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-06a34af1-4dba-42c3-b044-adc7f8a2f0fa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:38.537741 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-06a34af1-4dba-42c3-b044-adc7f8a2f0fa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:38.538251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-06a34af1-4dba-42c3-b044-adc7f8a2f0fa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:38.538675 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-06a34af1-4dba-42c3-b044-adc7f8a2f0fa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:38.681103 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-06a34af1-4dba-42c3-b044-adc7f8a2f0fa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:38.689508 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-06a34af1-4dba-42c3-b044-adc7f8a2f0fa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.165762 Aug 24 11:25:38.690819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 80/163] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:38 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:38.820933 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0284b63d-5e1a-43d7-8ef1-2d5f1bf5dbd7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:38.821554 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0284b63d-5e1a-43d7-8ef1-2d5f1bf5dbd7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:38.828613 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0284b63d-5e1a-43d7-8ef1-2d5f1bf5dbd7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:38.829097 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0284b63d-5e1a-43d7-8ef1-2d5f1bf5dbd7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:38.829524 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0284b63d-5e1a-43d7-8ef1-2d5f1bf5dbd7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:38.830229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0284b63d-5e1a-43d7-8ef1-2d5f1bf5dbd7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:38.830674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0284b63d-5e1a-43d7-8ef1-2d5f1bf5dbd7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:38.831086 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0284b63d-5e1a-43d7-8ef1-2d5f1bf5dbd7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:38.959681 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0284b63d-5e1a-43d7-8ef1-2d5f1bf5dbd7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:38.967295 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0284b63d-5e1a-43d7-8ef1-2d5f1bf5dbd7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.150630 Aug 24 11:25:38.967859 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 84/164] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:38 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:39.440078 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-81aa1f5d-8ea7-4eb0-94e8-e9a589f308f3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:39.440771 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-81aa1f5d-8ea7-4eb0-94e8-e9a589f308f3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:39.446913 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-81aa1f5d-8ea7-4eb0-94e8-e9a589f308f3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:39.447402 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-81aa1f5d-8ea7-4eb0-94e8-e9a589f308f3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:39.447836 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-81aa1f5d-8ea7-4eb0-94e8-e9a589f308f3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:39.448520 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-81aa1f5d-8ea7-4eb0-94e8-e9a589f308f3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:39.448970 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-81aa1f5d-8ea7-4eb0-94e8-e9a589f308f3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:39.449392 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-81aa1f5d-8ea7-4eb0-94e8-e9a589f308f3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:39.579931 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-81aa1f5d-8ea7-4eb0-94e8-e9a589f308f3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:39.587790 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-81aa1f5d-8ea7-4eb0-94e8-e9a589f308f3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.151601 Aug 24 11:25:39.588357 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 81/165] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:39 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:39.709986 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f97fadd4-4276-4047-8f95-d0d911f0d285 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:39.710598 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f97fadd4-4276-4047-8f95-d0d911f0d285 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:39.717118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f97fadd4-4276-4047-8f95-d0d911f0d285 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:39.717598 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f97fadd4-4276-4047-8f95-d0d911f0d285 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:39.718060 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f97fadd4-4276-4047-8f95-d0d911f0d285 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:39.718870 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f97fadd4-4276-4047-8f95-d0d911f0d285 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:39.719324 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f97fadd4-4276-4047-8f95-d0d911f0d285 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:39.719742 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f97fadd4-4276-4047-8f95-d0d911f0d285 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:39.847870 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f97fadd4-4276-4047-8f95-d0d911f0d285 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:39.855522 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f97fadd4-4276-4047-8f95-d0d911f0d285 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.149291 Aug 24 11:25:39.856071 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 85/166] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:39 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:39.987992 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8e65533d-fc49-47f5-935e-295518b2cd5d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:39.988599 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8e65533d-fc49-47f5-935e-295518b2cd5d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:39.994981 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e65533d-fc49-47f5-935e-295518b2cd5d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:39.995463 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e65533d-fc49-47f5-935e-295518b2cd5d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:39.995897 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e65533d-fc49-47f5-935e-295518b2cd5d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:39.996579 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e65533d-fc49-47f5-935e-295518b2cd5d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:39.997029 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e65533d-fc49-47f5-935e-295518b2cd5d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:39.997468 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e65533d-fc49-47f5-935e-295518b2cd5d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:40.130421 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8e65533d-fc49-47f5-935e-295518b2cd5d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:40.138135 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8e65533d-fc49-47f5-935e-295518b2cd5d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.154032 Aug 24 11:25:40.139287 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 82/167] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:39 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:40.609619 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-92d7b1cd-a27f-454c-b0b5-3a832d2d9d72 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:40.610266 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-92d7b1cd-a27f-454c-b0b5-3a832d2d9d72 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:40.616381 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92d7b1cd-a27f-454c-b0b5-3a832d2d9d72 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:40.616871 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92d7b1cd-a27f-454c-b0b5-3a832d2d9d72 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:40.617312 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92d7b1cd-a27f-454c-b0b5-3a832d2d9d72 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:40.618190 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92d7b1cd-a27f-454c-b0b5-3a832d2d9d72 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:40.618653 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92d7b1cd-a27f-454c-b0b5-3a832d2d9d72 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:40.619091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92d7b1cd-a27f-454c-b0b5-3a832d2d9d72 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:40.757547 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-92d7b1cd-a27f-454c-b0b5-3a832d2d9d72 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:40.765523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-92d7b1cd-a27f-454c-b0b5-3a832d2d9d72 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.160371 Aug 24 11:25:40.766178 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 86/168] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:40 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:40.876798 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c6bcf6e2-c6bd-41e7-844d-a7ca872eaafc tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:40.877399 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c6bcf6e2-c6bd-41e7-844d-a7ca872eaafc tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:40.883350 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6bcf6e2-c6bd-41e7-844d-a7ca872eaafc tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:40.883825 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6bcf6e2-c6bd-41e7-844d-a7ca872eaafc tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:40.884259 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6bcf6e2-c6bd-41e7-844d-a7ca872eaafc tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:40.884951 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6bcf6e2-c6bd-41e7-844d-a7ca872eaafc tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:40.885379 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6bcf6e2-c6bd-41e7-844d-a7ca872eaafc tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:40.885792 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6bcf6e2-c6bd-41e7-844d-a7ca872eaafc tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:41.013301 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c6bcf6e2-c6bd-41e7-844d-a7ca872eaafc tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:41.021042 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c6bcf6e2-c6bd-41e7-844d-a7ca872eaafc tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.148750 Aug 24 11:25:41.021609 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 83/169] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:40 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:41.159791 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fccec5a2-5a96-4440-9f38-d18b67f8a33d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:41.160269 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fccec5a2-5a96-4440-9f38-d18b67f8a33d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:41.166593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fccec5a2-5a96-4440-9f38-d18b67f8a33d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:41.167081 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fccec5a2-5a96-4440-9f38-d18b67f8a33d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:41.167562 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fccec5a2-5a96-4440-9f38-d18b67f8a33d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:41.168254 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fccec5a2-5a96-4440-9f38-d18b67f8a33d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:41.168707 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fccec5a2-5a96-4440-9f38-d18b67f8a33d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:41.169128 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fccec5a2-5a96-4440-9f38-d18b67f8a33d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:41.298704 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fccec5a2-5a96-4440-9f38-d18b67f8a33d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:41.306280 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fccec5a2-5a96-4440-9f38-d18b67f8a33d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.150530 Aug 24 11:25:41.306849 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 87/170] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:41 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:41.785679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6d3ec563-1c1e-4e63-b21c-07d900dbf855 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:41.786394 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6d3ec563-1c1e-4e63-b21c-07d900dbf855 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:41.792848 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6d3ec563-1c1e-4e63-b21c-07d900dbf855 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:41.793334 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6d3ec563-1c1e-4e63-b21c-07d900dbf855 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:41.793792 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6d3ec563-1c1e-4e63-b21c-07d900dbf855 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:41.794533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6d3ec563-1c1e-4e63-b21c-07d900dbf855 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:41.795121 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6d3ec563-1c1e-4e63-b21c-07d900dbf855 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:41.795409 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6d3ec563-1c1e-4e63-b21c-07d900dbf855 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:41.927487 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6d3ec563-1c1e-4e63-b21c-07d900dbf855 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:41.935068 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6d3ec563-1c1e-4e63-b21c-07d900dbf855 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.153328 Aug 24 11:25:41.935667 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 84/171] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:41 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:42.041656 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-91dba2e5-77e6-4079-a423-d91daf0407f1 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:42.042311 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-91dba2e5-77e6-4079-a423-d91daf0407f1 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:42.048334 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91dba2e5-77e6-4079-a423-d91daf0407f1 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:42.048810 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91dba2e5-77e6-4079-a423-d91daf0407f1 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:42.049239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91dba2e5-77e6-4079-a423-d91daf0407f1 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:42.049944 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91dba2e5-77e6-4079-a423-d91daf0407f1 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:42.050390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91dba2e5-77e6-4079-a423-d91daf0407f1 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:42.050803 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91dba2e5-77e6-4079-a423-d91daf0407f1 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:42.175033 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-91dba2e5-77e6-4079-a423-d91daf0407f1 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:42.182712 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-91dba2e5-77e6-4079-a423-d91daf0407f1 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.145234 Aug 24 11:25:42.183567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 88/172] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:42 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:42.326713 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9f7ca308-6639-4715-a411-4fa2ef78cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:42.327358 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9f7ca308-6639-4715-a411-4fa2ef78cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:42.333334 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9f7ca308-6639-4715-a411-4fa2ef78cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:42.333816 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9f7ca308-6639-4715-a411-4fa2ef78cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:42.334276 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9f7ca308-6639-4715-a411-4fa2ef78cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:42.334954 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9f7ca308-6639-4715-a411-4fa2ef78cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:42.335407 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9f7ca308-6639-4715-a411-4fa2ef78cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:42.335865 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9f7ca308-6639-4715-a411-4fa2ef78cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:42.463561 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9f7ca308-6639-4715-a411-4fa2ef78cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:42.471431 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9f7ca308-6639-4715-a411-4fa2ef78cca4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.148622 Aug 24 11:25:42.472884 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 85/173] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:42 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:42.956072 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-33b58cfc-e9c4-42bc-ae73-69b7600d6a07 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:42.956742 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-33b58cfc-e9c4-42bc-ae73-69b7600d6a07 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:42.962773 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33b58cfc-e9c4-42bc-ae73-69b7600d6a07 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:42.963256 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33b58cfc-e9c4-42bc-ae73-69b7600d6a07 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:42.963688 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33b58cfc-e9c4-42bc-ae73-69b7600d6a07 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:42.964452 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33b58cfc-e9c4-42bc-ae73-69b7600d6a07 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:42.964904 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33b58cfc-e9c4-42bc-ae73-69b7600d6a07 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:42.965325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33b58cfc-e9c4-42bc-ae73-69b7600d6a07 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:43.097385 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-33b58cfc-e9c4-42bc-ae73-69b7600d6a07 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:43.105089 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-33b58cfc-e9c4-42bc-ae73-69b7600d6a07 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.153496 Aug 24 11:25:43.105655 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 89/174] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:42 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:43.204020 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-bb75d9b8-2f18-45c2-8471-d516b204176b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:43.204658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-bb75d9b8-2f18-45c2-8471-d516b204176b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:43.210952 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb75d9b8-2f18-45c2-8471-d516b204176b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:43.211436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb75d9b8-2f18-45c2-8471-d516b204176b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:43.211871 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb75d9b8-2f18-45c2-8471-d516b204176b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:43.212556 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb75d9b8-2f18-45c2-8471-d516b204176b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:43.213010 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb75d9b8-2f18-45c2-8471-d516b204176b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:43.213426 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb75d9b8-2f18-45c2-8471-d516b204176b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:43.231564 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=100 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:43.344721 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-bb75d9b8-2f18-45c2-8471-d516b204176b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:43.352454 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-bb75d9b8-2f18-45c2-8471-d516b204176b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.152483 Aug 24 11:25:43.353019 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 86/175] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:43 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:43.493291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-92dac2e0-9f0f-468c-b3f0-c74750120b10 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:43.493913 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-92dac2e0-9f0f-468c-b3f0-c74750120b10 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:43.500452 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92dac2e0-9f0f-468c-b3f0-c74750120b10 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:43.500931 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92dac2e0-9f0f-468c-b3f0-c74750120b10 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:43.501362 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92dac2e0-9f0f-468c-b3f0-c74750120b10 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:43.502064 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92dac2e0-9f0f-468c-b3f0-c74750120b10 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:43.502515 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92dac2e0-9f0f-468c-b3f0-c74750120b10 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:43.502922 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92dac2e0-9f0f-468c-b3f0-c74750120b10 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:43.633422 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-92dac2e0-9f0f-468c-b3f0-c74750120b10 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:43.641300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-92dac2e0-9f0f-468c-b3f0-c74750120b10 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.151796 Aug 24 11:25:43.641883 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 90/176] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:43 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:44.126087 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f0397a7f-2c6a-42db-b515-ca79545aef9e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:44.126697 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f0397a7f-2c6a-42db-b515-ca79545aef9e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:44.132910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f0397a7f-2c6a-42db-b515-ca79545aef9e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:44.133404 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f0397a7f-2c6a-42db-b515-ca79545aef9e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:44.133836 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f0397a7f-2c6a-42db-b515-ca79545aef9e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:44.134731 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f0397a7f-2c6a-42db-b515-ca79545aef9e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:44.135072 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f0397a7f-2c6a-42db-b515-ca79545aef9e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:44.135494 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f0397a7f-2c6a-42db-b515-ca79545aef9e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:44.267733 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f0397a7f-2c6a-42db-b515-ca79545aef9e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:44.275621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f0397a7f-2c6a-42db-b515-ca79545aef9e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.153406 Aug 24 11:25:44.276187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 87/177] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:44 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:44.372425 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2c26188d-6043-4087-abf9-be5980c5d8e2 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:44.373224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2c26188d-6043-4087-abf9-be5980c5d8e2 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:44.375669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=79 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:44.380302 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c26188d-6043-4087-abf9-be5980c5d8e2 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:44.380789 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c26188d-6043-4087-abf9-be5980c5d8e2 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:44.381223 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c26188d-6043-4087-abf9-be5980c5d8e2 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:44.381941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c26188d-6043-4087-abf9-be5980c5d8e2 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:44.382391 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c26188d-6043-4087-abf9-be5980c5d8e2 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:44.385760 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c26188d-6043-4087-abf9-be5980c5d8e2 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:44.514437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2c26188d-6043-4087-abf9-be5980c5d8e2 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:44.522759 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2c26188d-6043-4087-abf9-be5980c5d8e2 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.154101 Aug 24 11:25:44.523333 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 91/178] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:44 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:44.662028 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8a33e75a-48fc-4671-923f-60be614ba54c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:44.662524 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8a33e75a-48fc-4671-923f-60be614ba54c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:44.669207 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8a33e75a-48fc-4671-923f-60be614ba54c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:44.669704 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8a33e75a-48fc-4671-923f-60be614ba54c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:44.670164 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8a33e75a-48fc-4671-923f-60be614ba54c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:44.670842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8a33e75a-48fc-4671-923f-60be614ba54c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:44.671787 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8a33e75a-48fc-4671-923f-60be614ba54c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:44.672233 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8a33e75a-48fc-4671-923f-60be614ba54c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:44.807144 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8a33e75a-48fc-4671-923f-60be614ba54c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:44.815871 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8a33e75a-48fc-4671-923f-60be614ba54c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.157810 Aug 24 11:25:44.821039 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 88/179] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:44 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:45.297037 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-386ffa77-e3f5-421c-a026-872f9c614cec tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:45.297752 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-386ffa77-e3f5-421c-a026-872f9c614cec tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:45.303805 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-386ffa77-e3f5-421c-a026-872f9c614cec tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:45.304281 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-386ffa77-e3f5-421c-a026-872f9c614cec tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:45.304710 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-386ffa77-e3f5-421c-a026-872f9c614cec tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:45.305381 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-386ffa77-e3f5-421c-a026-872f9c614cec tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:45.305827 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-386ffa77-e3f5-421c-a026-872f9c614cec tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:45.306268 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-386ffa77-e3f5-421c-a026-872f9c614cec tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:45.435057 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-386ffa77-e3f5-421c-a026-872f9c614cec tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:45.442797 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-386ffa77-e3f5-421c-a026-872f9c614cec tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.150177 Aug 24 11:25:45.443363 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 92/180] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:45 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:45.543038 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5f4cb11b-f640-414b-b6d9-2a5894d8f893 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:45.543636 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5f4cb11b-f640-414b-b6d9-2a5894d8f893 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:45.550268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f4cb11b-f640-414b-b6d9-2a5894d8f893 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:45.550680 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f4cb11b-f640-414b-b6d9-2a5894d8f893 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:45.551101 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f4cb11b-f640-414b-b6d9-2a5894d8f893 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:45.551785 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f4cb11b-f640-414b-b6d9-2a5894d8f893 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:45.552225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f4cb11b-f640-414b-b6d9-2a5894d8f893 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:45.552637 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f4cb11b-f640-414b-b6d9-2a5894d8f893 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:45.683724 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5f4cb11b-f640-414b-b6d9-2a5894d8f893 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:45.691299 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5f4cb11b-f640-414b-b6d9-2a5894d8f893 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.152450 Aug 24 11:25:45.691860 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 89/181] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:45 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:45.836335 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d8c7511c-94b7-45d7-86cd-107ec5bc11c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:45.836983 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d8c7511c-94b7-45d7-86cd-107ec5bc11c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:45.843208 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d8c7511c-94b7-45d7-86cd-107ec5bc11c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:45.843579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d8c7511c-94b7-45d7-86cd-107ec5bc11c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:45.843958 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d8c7511c-94b7-45d7-86cd-107ec5bc11c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:45.844719 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d8c7511c-94b7-45d7-86cd-107ec5bc11c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:45.845238 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d8c7511c-94b7-45d7-86cd-107ec5bc11c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:45.845659 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d8c7511c-94b7-45d7-86cd-107ec5bc11c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:45.972300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d8c7511c-94b7-45d7-86cd-107ec5bc11c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:45.980502 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d8c7511c-94b7-45d7-86cd-107ec5bc11c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.147964 Aug 24 11:25:45.981069 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 93/182] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:45 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:46.463678 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-91877f9d-6d61-4868-96f9-4a2e685ab76c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:46.464192 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-91877f9d-6d61-4868-96f9-4a2e685ab76c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:46.471154 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-91877f9d-6d61-4868-96f9-4a2e685ab76c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:46.471630 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-91877f9d-6d61-4868-96f9-4a2e685ab76c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:46.472056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-91877f9d-6d61-4868-96f9-4a2e685ab76c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:46.472729 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-91877f9d-6d61-4868-96f9-4a2e685ab76c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:46.473171 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-91877f9d-6d61-4868-96f9-4a2e685ab76c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:46.473582 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-91877f9d-6d61-4868-96f9-4a2e685ab76c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:46.601078 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-91877f9d-6d61-4868-96f9-4a2e685ab76c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:46.608758 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-91877f9d-6d61-4868-96f9-4a2e685ab76c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.149067 Aug 24 11:25:46.609326 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 90/183] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:46 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:46.711995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-999b830f-ead9-435e-9a5d-75c87db35788 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:46.712619 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-999b830f-ead9-435e-9a5d-75c87db35788 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:46.729641 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-999b830f-ead9-435e-9a5d-75c87db35788 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:46.729641 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-999b830f-ead9-435e-9a5d-75c87db35788 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:46.729641 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-999b830f-ead9-435e-9a5d-75c87db35788 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:46.729641 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-999b830f-ead9-435e-9a5d-75c87db35788 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:46.730370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-999b830f-ead9-435e-9a5d-75c87db35788 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:46.730370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-999b830f-ead9-435e-9a5d-75c87db35788 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:46.855699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-999b830f-ead9-435e-9a5d-75c87db35788 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:46.867575 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-999b830f-ead9-435e-9a5d-75c87db35788 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.156190 Aug 24 11:25:46.867575 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 94/184] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:46 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:47.001135 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6e763567-8c9e-49e7-bf6c-7ad233cbead4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:47.001744 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6e763567-8c9e-49e7-bf6c-7ad233cbead4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:47.008121 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6e763567-8c9e-49e7-bf6c-7ad233cbead4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:47.008609 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6e763567-8c9e-49e7-bf6c-7ad233cbead4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:47.009029 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6e763567-8c9e-49e7-bf6c-7ad233cbead4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:47.009721 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6e763567-8c9e-49e7-bf6c-7ad233cbead4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:47.010192 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6e763567-8c9e-49e7-bf6c-7ad233cbead4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:47.010721 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6e763567-8c9e-49e7-bf6c-7ad233cbead4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:47.150992 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6e763567-8c9e-49e7-bf6c-7ad233cbead4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:47.158916 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6e763567-8c9e-49e7-bf6c-7ad233cbead4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.162165 Aug 24 11:25:47.159507 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 91/185] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:46 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:47.630547 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5e1a5bac-6f96-46ab-ab3f-5d2de5e6d9f8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:47.631061 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5e1a5bac-6f96-46ab-ab3f-5d2de5e6d9f8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:47.637285 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e1a5bac-6f96-46ab-ab3f-5d2de5e6d9f8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:47.637770 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e1a5bac-6f96-46ab-ab3f-5d2de5e6d9f8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:47.638219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e1a5bac-6f96-46ab-ab3f-5d2de5e6d9f8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:47.638892 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e1a5bac-6f96-46ab-ab3f-5d2de5e6d9f8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:47.639352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e1a5bac-6f96-46ab-ab3f-5d2de5e6d9f8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:47.640274 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e1a5bac-6f96-46ab-ab3f-5d2de5e6d9f8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:47.768233 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5e1a5bac-6f96-46ab-ab3f-5d2de5e6d9f8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:47.776138 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5e1a5bac-6f96-46ab-ab3f-5d2de5e6d9f8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.149466 Aug 24 11:25:47.776712 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 95/186] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:47 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:47.889372 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7f143ddb-3e42-45eb-9c77-c85d3d7bc675 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:47.889372 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7f143ddb-3e42-45eb-9c77-c85d3d7bc675 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:47.894517 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7f143ddb-3e42-45eb-9c77-c85d3d7bc675 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:47.894992 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7f143ddb-3e42-45eb-9c77-c85d3d7bc675 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:47.895423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7f143ddb-3e42-45eb-9c77-c85d3d7bc675 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:47.896333 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7f143ddb-3e42-45eb-9c77-c85d3d7bc675 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:47.896750 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7f143ddb-3e42-45eb-9c77-c85d3d7bc675 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:47.897205 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7f143ddb-3e42-45eb-9c77-c85d3d7bc675 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:48.027371 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7f143ddb-3e42-45eb-9c77-c85d3d7bc675 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:48.033981 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7f143ddb-3e42-45eb-9c77-c85d3d7bc675 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.151896 Aug 24 11:25:48.034555 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 92/187] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:47 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:48.181246 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-72fa2611-de5a-4380-a9c2-a36f2dc1387a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:48.181774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-72fa2611-de5a-4380-a9c2-a36f2dc1387a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:48.188221 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-72fa2611-de5a-4380-a9c2-a36f2dc1387a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:48.188699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-72fa2611-de5a-4380-a9c2-a36f2dc1387a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:48.189128 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-72fa2611-de5a-4380-a9c2-a36f2dc1387a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:48.189802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-72fa2611-de5a-4380-a9c2-a36f2dc1387a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:48.190277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-72fa2611-de5a-4380-a9c2-a36f2dc1387a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:48.190692 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-72fa2611-de5a-4380-a9c2-a36f2dc1387a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:48.320805 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-72fa2611-de5a-4380-a9c2-a36f2dc1387a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:48.329259 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-72fa2611-de5a-4380-a9c2-a36f2dc1387a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.151940 Aug 24 11:25:48.329835 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 96/188] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:48 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:48.798061 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-70a21672-7d03-400d-b394-599f558c1c3a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:48.798666 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-70a21672-7d03-400d-b394-599f558c1c3a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:48.804794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-70a21672-7d03-400d-b394-599f558c1c3a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:48.805276 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-70a21672-7d03-400d-b394-599f558c1c3a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:48.805707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-70a21672-7d03-400d-b394-599f558c1c3a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:48.806435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-70a21672-7d03-400d-b394-599f558c1c3a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:48.806897 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-70a21672-7d03-400d-b394-599f558c1c3a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:48.807316 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-70a21672-7d03-400d-b394-599f558c1c3a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:48.934892 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-70a21672-7d03-400d-b394-599f558c1c3a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:48.943868 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-70a21672-7d03-400d-b394-599f558c1c3a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.150251 Aug 24 11:25:48.944463 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 93/189] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:48 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:49.054752 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-aacb17eb-7d80-475b-8842-62926cfee9fe tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:49.058656 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-aacb17eb-7d80-475b-8842-62926cfee9fe tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:49.061310 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aacb17eb-7d80-475b-8842-62926cfee9fe tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:49.061821 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aacb17eb-7d80-475b-8842-62926cfee9fe tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:49.062282 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aacb17eb-7d80-475b-8842-62926cfee9fe tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:49.062968 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aacb17eb-7d80-475b-8842-62926cfee9fe tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:49.063414 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aacb17eb-7d80-475b-8842-62926cfee9fe tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:49.063906 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aacb17eb-7d80-475b-8842-62926cfee9fe tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:49.194176 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-aacb17eb-7d80-475b-8842-62926cfee9fe tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:49.202789 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-aacb17eb-7d80-475b-8842-62926cfee9fe tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1315 microversion: 2.1 time: 0.151352 Aug 24 11:25:49.203471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 97/190] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:49 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:49.270621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-77d563c1-6317-4282-89a4-bccea4238995 req-3af52dff-6800-4652-89ed-a67841da5734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "855ac5ba-541c-4dc9-8a34-122679948e06", "name": "network-vif-plugged", "status": "completed", "tag": "8a3e4fbb-fe41-4624-9e7f-cbd92817419e"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:49.280232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-77d563c1-6317-4282-89a4-bccea4238995 req-3af52dff-6800-4652-89ed-a67841da5734 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:49.280711 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-77d563c1-6317-4282-89a4-bccea4238995 req-3af52dff-6800-4652-89ed-a67841da5734 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:49.281142 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-77d563c1-6317-4282-89a4-bccea4238995 req-3af52dff-6800-4652-89ed-a67841da5734 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:49.293074 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-77d563c1-6317-4282-89a4-bccea4238995 req-3af52dff-6800-4652-89ed-a67841da5734 service nova] Creating event network-vif-plugged:8a3e4fbb-fe41-4624-9e7f-cbd92817419e for instance 855ac5ba-541c-4dc9-8a34-122679948e06 on hv-cinder-85427 Aug 24 11:25:49.299500 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-77d563c1-6317-4282-89a4-bccea4238995 req-3af52dff-6800-4652-89ed-a67841da5734 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032516 Aug 24 11:25:49.300104 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 94/191] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:49.350356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cc5f9152-39b5-4170-9585-2ed235bd1f0d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:49.351047 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cc5f9152-39b5-4170-9585-2ed235bd1f0d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:49.357341 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc5f9152-39b5-4170-9585-2ed235bd1f0d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:49.358059 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc5f9152-39b5-4170-9585-2ed235bd1f0d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:49.359230 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc5f9152-39b5-4170-9585-2ed235bd1f0d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:49.360111 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc5f9152-39b5-4170-9585-2ed235bd1f0d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:49.360399 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc5f9152-39b5-4170-9585-2ed235bd1f0d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:49.360942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc5f9152-39b5-4170-9585-2ed235bd1f0d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:49.494195 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cc5f9152-39b5-4170-9585-2ed235bd1f0d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:49.502813 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cc5f9152-39b5-4170-9585-2ed235bd1f0d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.156292 Aug 24 11:25:49.503390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 98/192] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:49 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:49.964970 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-110c063f-00ae-4b2e-9a53-b82b23355f91 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:49.965667 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-110c063f-00ae-4b2e-9a53-b82b23355f91 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:49.972957 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-110c063f-00ae-4b2e-9a53-b82b23355f91 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:49.973486 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-110c063f-00ae-4b2e-9a53-b82b23355f91 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:49.973850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-110c063f-00ae-4b2e-9a53-b82b23355f91 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:49.974568 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-110c063f-00ae-4b2e-9a53-b82b23355f91 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:49.975009 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-110c063f-00ae-4b2e-9a53-b82b23355f91 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:49.975421 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-110c063f-00ae-4b2e-9a53-b82b23355f91 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:50.126868 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-110c063f-00ae-4b2e-9a53-b82b23355f91 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:50.135152 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-110c063f-00ae-4b2e-9a53-b82b23355f91 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.174261 Aug 24 11:25:50.135813 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 95/193] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:49 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:50.227444 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-604ca9ae-1bae-4c90-a1b8-2ac7e593240b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:50.228122 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-604ca9ae-1bae-4c90-a1b8-2ac7e593240b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:50.234164 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-604ca9ae-1bae-4c90-a1b8-2ac7e593240b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:50.234638 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-604ca9ae-1bae-4c90-a1b8-2ac7e593240b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:50.235213 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-604ca9ae-1bae-4c90-a1b8-2ac7e593240b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:50.235757 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-604ca9ae-1bae-4c90-a1b8-2ac7e593240b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:50.236197 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-604ca9ae-1bae-4c90-a1b8-2ac7e593240b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:50.236607 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-604ca9ae-1bae-4c90-a1b8-2ac7e593240b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:50.370150 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-604ca9ae-1bae-4c90-a1b8-2ac7e593240b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:50.383520 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-604ca9ae-1bae-4c90-a1b8-2ac7e593240b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1502 microversion: 2.1 time: 0.159888 Aug 24 11:25:50.384642 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 99/194] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:50 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:50.523911 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-036ce52f-1eac-408e-8c93-4fb183f6a8de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:50.524829 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-036ce52f-1eac-408e-8c93-4fb183f6a8de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:50.531896 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-036ce52f-1eac-408e-8c93-4fb183f6a8de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:50.532500 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-036ce52f-1eac-408e-8c93-4fb183f6a8de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:50.533116 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-036ce52f-1eac-408e-8c93-4fb183f6a8de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:50.533801 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-036ce52f-1eac-408e-8c93-4fb183f6a8de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:50.534275 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-036ce52f-1eac-408e-8c93-4fb183f6a8de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:50.534966 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-036ce52f-1eac-408e-8c93-4fb183f6a8de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:50.669612 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-036ce52f-1eac-408e-8c93-4fb183f6a8de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:50.679897 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-036ce52f-1eac-408e-8c93-4fb183f6a8de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.159841 Aug 24 11:25:50.680571 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 96/195] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:50 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:51.156657 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8002ef86-a2a5-4997-9e6f-eacb7fae6c8a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:51.157373 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8002ef86-a2a5-4997-9e6f-eacb7fae6c8a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:51.163568 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8002ef86-a2a5-4997-9e6f-eacb7fae6c8a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:51.164100 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8002ef86-a2a5-4997-9e6f-eacb7fae6c8a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:51.164540 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8002ef86-a2a5-4997-9e6f-eacb7fae6c8a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:51.165518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8002ef86-a2a5-4997-9e6f-eacb7fae6c8a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:51.165985 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8002ef86-a2a5-4997-9e6f-eacb7fae6c8a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:51.166433 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8002ef86-a2a5-4997-9e6f-eacb7fae6c8a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:51.185268 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:51.320427 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8002ef86-a2a5-4997-9e6f-eacb7fae6c8a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:51.330600 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8002ef86-a2a5-4997-9e6f-eacb7fae6c8a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.177777 Aug 24 11:25:51.331768 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 100/196] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:51 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:51.700454 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3402abe4-64cd-4b7c-bf9f-d4955487a032 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:51.700967 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3402abe4-64cd-4b7c-bf9f-d4955487a032 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:51.707737 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3402abe4-64cd-4b7c-bf9f-d4955487a032 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:51.707737 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3402abe4-64cd-4b7c-bf9f-d4955487a032 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:51.708045 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3402abe4-64cd-4b7c-bf9f-d4955487a032 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:51.708710 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3402abe4-64cd-4b7c-bf9f-d4955487a032 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:51.709150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3402abe4-64cd-4b7c-bf9f-d4955487a032 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:51.709559 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3402abe4-64cd-4b7c-bf9f-d4955487a032 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:51.841037 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3402abe4-64cd-4b7c-bf9f-d4955487a032 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:51.849212 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3402abe4-64cd-4b7c-bf9f-d4955487a032 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.152638 Aug 24 11:25:51.849778 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 97/197] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:51 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:52.351596 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2c81a394-2fb8-4302-9a20-5d47e800b1f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:52.352203 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2c81a394-2fb8-4302-9a20-5d47e800b1f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:52.358230 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c81a394-2fb8-4302-9a20-5d47e800b1f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:52.358721 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c81a394-2fb8-4302-9a20-5d47e800b1f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:52.359146 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c81a394-2fb8-4302-9a20-5d47e800b1f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:52.359889 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c81a394-2fb8-4302-9a20-5d47e800b1f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:52.360265 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c81a394-2fb8-4302-9a20-5d47e800b1f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:52.360678 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c81a394-2fb8-4302-9a20-5d47e800b1f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:52.496001 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2c81a394-2fb8-4302-9a20-5d47e800b1f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:52.504319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2c81a394-2fb8-4302-9a20-5d47e800b1f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.156471 Aug 24 11:25:52.504888 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 101/198] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:52 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:52.870338 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-236d7894-dbe4-410a-981d-dd378926d70d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:52.870941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-236d7894-dbe4-410a-981d-dd378926d70d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:52.877024 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-236d7894-dbe4-410a-981d-dd378926d70d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:52.877501 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-236d7894-dbe4-410a-981d-dd378926d70d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:52.877970 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-236d7894-dbe4-410a-981d-dd378926d70d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:52.878633 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-236d7894-dbe4-410a-981d-dd378926d70d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:52.879073 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-236d7894-dbe4-410a-981d-dd378926d70d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:52.879485 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-236d7894-dbe4-410a-981d-dd378926d70d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:53.008221 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-236d7894-dbe4-410a-981d-dd378926d70d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:53.016337 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-236d7894-dbe4-410a-981d-dd378926d70d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.149931 Aug 24 11:25:53.016906 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 98/199] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:52 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:53.528450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1dd01b67-0d3e-4ae5-bd0a-1f3c2e66741f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:53.528989 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1dd01b67-0d3e-4ae5-bd0a-1f3c2e66741f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:53.535055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1dd01b67-0d3e-4ae5-bd0a-1f3c2e66741f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:53.535533 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1dd01b67-0d3e-4ae5-bd0a-1f3c2e66741f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:53.535967 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1dd01b67-0d3e-4ae5-bd0a-1f3c2e66741f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:53.536654 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1dd01b67-0d3e-4ae5-bd0a-1f3c2e66741f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:53.537109 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1dd01b67-0d3e-4ae5-bd0a-1f3c2e66741f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:53.537531 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1dd01b67-0d3e-4ae5-bd0a-1f3c2e66741f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:53.667022 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1dd01b67-0d3e-4ae5-bd0a-1f3c2e66741f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:53.675137 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1dd01b67-0d3e-4ae5-bd0a-1f3c2e66741f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.150570 Aug 24 11:25:53.675699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 102/200] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:53 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:54.037134 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6b277b2d-b8c1-4df3-bb9d-70aefa0ebe21 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:54.037738 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6b277b2d-b8c1-4df3-bb9d-70aefa0ebe21 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:54.043881 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b277b2d-b8c1-4df3-bb9d-70aefa0ebe21 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:54.044352 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b277b2d-b8c1-4df3-bb9d-70aefa0ebe21 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:54.044773 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b277b2d-b8c1-4df3-bb9d-70aefa0ebe21 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:54.045444 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b277b2d-b8c1-4df3-bb9d-70aefa0ebe21 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:54.046525 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b277b2d-b8c1-4df3-bb9d-70aefa0ebe21 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:54.046938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b277b2d-b8c1-4df3-bb9d-70aefa0ebe21 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:54.182299 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6b277b2d-b8c1-4df3-bb9d-70aefa0ebe21 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:54.189895 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6b277b2d-b8c1-4df3-bb9d-70aefa0ebe21 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.156596 Aug 24 11:25:54.190465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 99/201] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:54 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:54.695955 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5f3c50fb-2afd-4a77-89a8-e062032ced02 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:54.696661 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5f3c50fb-2afd-4a77-89a8-e062032ced02 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:54.703063 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f3c50fb-2afd-4a77-89a8-e062032ced02 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:54.703540 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f3c50fb-2afd-4a77-89a8-e062032ced02 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:54.704003 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f3c50fb-2afd-4a77-89a8-e062032ced02 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:54.704675 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f3c50fb-2afd-4a77-89a8-e062032ced02 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:54.705117 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f3c50fb-2afd-4a77-89a8-e062032ced02 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:54.705528 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f3c50fb-2afd-4a77-89a8-e062032ced02 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:54.833765 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5f3c50fb-2afd-4a77-89a8-e062032ced02 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:54.841504 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5f3c50fb-2afd-4a77-89a8-e062032ced02 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1361 microversion: 2.1 time: 0.149386 Aug 24 11:25:54.847743 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 103/202] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:54 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:55.210164 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ce2daa32-a023-4496-a468-21d3792eb010 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:55.210714 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ce2daa32-a023-4496-a468-21d3792eb010 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:55.212685 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=84 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:25:55.217433 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce2daa32-a023-4496-a468-21d3792eb010 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:55.217940 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce2daa32-a023-4496-a468-21d3792eb010 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:55.218365 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce2daa32-a023-4496-a468-21d3792eb010 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:55.219040 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce2daa32-a023-4496-a468-21d3792eb010 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:55.219478 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce2daa32-a023-4496-a468-21d3792eb010 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:55.219965 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce2daa32-a023-4496-a468-21d3792eb010 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:55.356355 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ce2daa32-a023-4496-a468-21d3792eb010 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:55.364526 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ce2daa32-a023-4496-a468-21d3792eb010 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.158513 Aug 24 11:25:55.365085 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 100/203] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:55 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:55.866579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c3e6984f-ad6f-47cb-a2f8-65fa11721c03 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:55.867193 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c3e6984f-ad6f-47cb-a2f8-65fa11721c03 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:55.873561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3e6984f-ad6f-47cb-a2f8-65fa11721c03 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:55.874085 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3e6984f-ad6f-47cb-a2f8-65fa11721c03 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:55.874511 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3e6984f-ad6f-47cb-a2f8-65fa11721c03 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:55.875196 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3e6984f-ad6f-47cb-a2f8-65fa11721c03 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:55.875640 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3e6984f-ad6f-47cb-a2f8-65fa11721c03 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:55.876057 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3e6984f-ad6f-47cb-a2f8-65fa11721c03 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:56.009277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c3e6984f-ad6f-47cb-a2f8-65fa11721c03 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:56.023756 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c3e6984f-ad6f-47cb-a2f8-65fa11721c03 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1546 microversion: 2.1 time: 0.155559 Aug 24 11:25:56.023756 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 104/204] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:55 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:56.039397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a32560c2-2fbc-446b-8b47-9ed236b299e7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:56.040153 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a32560c2-2fbc-446b-8b47-9ed236b299e7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:56.047238 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a32560c2-2fbc-446b-8b47-9ed236b299e7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:56.047662 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a32560c2-2fbc-446b-8b47-9ed236b299e7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:56.048089 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a32560c2-2fbc-446b-8b47-9ed236b299e7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:56.048818 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a32560c2-2fbc-446b-8b47-9ed236b299e7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:56.049257 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a32560c2-2fbc-446b-8b47-9ed236b299e7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:56.049672 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a32560c2-2fbc-446b-8b47-9ed236b299e7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:56.164189 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a32560c2-2fbc-446b-8b47-9ed236b299e7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128634 Aug 24 11:25:56.165034 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 101/205] 10.222.0.83 () {58 vars in 1275 bytes} [Wed Aug 24 11:25:56 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:25:56.384643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b291d064-7cde-4ecd-a973-1ad26548466f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:56.385255 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b291d064-7cde-4ecd-a973-1ad26548466f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:56.392159 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b291d064-7cde-4ecd-a973-1ad26548466f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:56.392859 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b291d064-7cde-4ecd-a973-1ad26548466f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:56.393413 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b291d064-7cde-4ecd-a973-1ad26548466f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:56.394270 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b291d064-7cde-4ecd-a973-1ad26548466f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:56.394787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b291d064-7cde-4ecd-a973-1ad26548466f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:56.395299 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b291d064-7cde-4ecd-a973-1ad26548466f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:56.572472 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b291d064-7cde-4ecd-a973-1ad26548466f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:56.582849 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b291d064-7cde-4ecd-a973-1ad26548466f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.201917 Aug 24 11:25:56.599073 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 105/206] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:56 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:57.609806 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7f5d86cd-1c15-4091-9afe-26c682377de4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:57.612246 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7f5d86cd-1c15-4091-9afe-26c682377de4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:57.618581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-efffe6d9-5112-42ba-91cb-c8ca2d6e25a4 req-3da3309c-ae7f-4aed-866a-96c57aa651b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b611366f-7de9-4b85-8464-8a9b8aaed0c5", "tag": "6c35b179-c77c-456f-b02c-0af67673cd94"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:57.622377 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7f5d86cd-1c15-4091-9afe-26c682377de4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:57.624389 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7f5d86cd-1c15-4091-9afe-26c682377de4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:57.626686 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7f5d86cd-1c15-4091-9afe-26c682377de4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:57.628434 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7f5d86cd-1c15-4091-9afe-26c682377de4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:57.629107 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7f5d86cd-1c15-4091-9afe-26c682377de4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:57.629517 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-efffe6d9-5112-42ba-91cb-c8ca2d6e25a4 req-3da3309c-ae7f-4aed-866a-96c57aa651b8 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:57.629963 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-efffe6d9-5112-42ba-91cb-c8ca2d6e25a4 req-3da3309c-ae7f-4aed-866a-96c57aa651b8 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:57.630410 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-efffe6d9-5112-42ba-91cb-c8ca2d6e25a4 req-3da3309c-ae7f-4aed-866a-96c57aa651b8 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:57.630676 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7f5d86cd-1c15-4091-9afe-26c682377de4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:57.646277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-efffe6d9-5112-42ba-91cb-c8ca2d6e25a4 req-3da3309c-ae7f-4aed-866a-96c57aa651b8 service nova] Creating event network-changed:6c35b179-c77c-456f-b02c-0af67673cd94 for instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 on hv-cinder-85427 Aug 24 11:25:57.653838 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-efffe6d9-5112-42ba-91cb-c8ca2d6e25a4 req-3da3309c-ae7f-4aed-866a-96c57aa651b8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038627 Aug 24 11:25:57.654860 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 106/207] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:25:57.804959 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7f5d86cd-1c15-4091-9afe-26c682377de4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:57.814860 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7f5d86cd-1c15-4091-9afe-26c682377de4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.212617 Aug 24 11:25:57.816294 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 102/208] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:57 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:25:58.840446 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-630b8dff-4bca-4d61-ae74-e28ad870bb36 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:25:58.840446 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-630b8dff-4bca-4d61-ae74-e28ad870bb36 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:58.841572 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-304b9dda-3494-441a-927d-ff3dff01e37c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ded94677-ea99-4d2a-a3e1-98d0f542c2dd"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:25:58.844762 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-304b9dda-3494-441a-927d-ff3dff01e37c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:25:58.852171 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-630b8dff-4bca-4d61-ae74-e28ad870bb36 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:58.852694 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-304b9dda-3494-441a-927d-ff3dff01e37c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:58.852808 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-630b8dff-4bca-4d61-ae74-e28ad870bb36 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:58.853187 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-304b9dda-3494-441a-927d-ff3dff01e37c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:58.853511 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-630b8dff-4bca-4d61-ae74-e28ad870bb36 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:58.853624 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-304b9dda-3494-441a-927d-ff3dff01e37c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:58.854335 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-304b9dda-3494-441a-927d-ff3dff01e37c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:58.854440 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-630b8dff-4bca-4d61-ae74-e28ad870bb36 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:25:58.854789 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-304b9dda-3494-441a-927d-ff3dff01e37c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:58.854910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-630b8dff-4bca-4d61-ae74-e28ad870bb36 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:25:58.855210 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-304b9dda-3494-441a-927d-ff3dff01e37c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:58.855493 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-630b8dff-4bca-4d61-ae74-e28ad870bb36 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:25:59.054739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-630b8dff-4bca-4d61-ae74-e28ad870bb36 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:25:59.066952 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-630b8dff-4bca-4d61-ae74-e28ad870bb36 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1366 microversion: 2.1 time: 0.231193 Aug 24 11:25:59.068134 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 103/209] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:25:58 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:00.088900 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-fe8e1d9e-6951-450c-a25c-48a0631f6345 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:00.089617 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-fe8e1d9e-6951-450c-a25c-48a0631f6345 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:00.096933 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fe8e1d9e-6951-450c-a25c-48a0631f6345 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:00.099123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fe8e1d9e-6951-450c-a25c-48a0631f6345 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:00.099787 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fe8e1d9e-6951-450c-a25c-48a0631f6345 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:00.101135 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fe8e1d9e-6951-450c-a25c-48a0631f6345 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:00.101858 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fe8e1d9e-6951-450c-a25c-48a0631f6345 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:00.102487 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fe8e1d9e-6951-450c-a25c-48a0631f6345 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:00.110382 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=100 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:00.252182 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-fe8e1d9e-6951-450c-a25c-48a0631f6345 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:00.262410 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-fe8e1d9e-6951-450c-a25c-48a0631f6345 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1556 microversion: 2.1 time: 0.175632 Aug 24 11:26:00.262410 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 104/210] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:00 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:26:00.291882 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-65810dff-1fbc-4198-9847-6ff775f6b011 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:00.292385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-65810dff-1fbc-4198-9847-6ff775f6b011 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:00.299267 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-65810dff-1fbc-4198-9847-6ff775f6b011 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:00.299760 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-65810dff-1fbc-4198-9847-6ff775f6b011 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:00.300442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-65810dff-1fbc-4198-9847-6ff775f6b011 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:00.301150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-65810dff-1fbc-4198-9847-6ff775f6b011 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:00.301603 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-65810dff-1fbc-4198-9847-6ff775f6b011 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:00.302055 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-65810dff-1fbc-4198-9847-6ff775f6b011 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:00.391726 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-65810dff-1fbc-4198-9847-6ff775f6b011 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108363 Aug 24 11:26:00.391726 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 105/211] 10.222.0.83 () {58 vars in 1275 bytes} [Wed Aug 24 11:26:00 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:26:00.726729 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-304b9dda-3494-441a-927d-ff3dff01e37c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "POST /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.896515 Aug 24 11:26:00.735457 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 107/212] 10.222.0.83 () {60 vars in 1323 bytes} [Wed Aug 24 11:25:58 2022] POST /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81/os-volume_attachments => generated 194 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:01.854801 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-fee3e06c-b41c-4e5c-8c3a-5407d6d27eea req-6317fda9-461f-4fab-9bd0-2134906ad50b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "855ac5ba-541c-4dc9-8a34-122679948e06", "tag": "8a3e4fbb-fe41-4624-9e7f-cbd92817419e"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:01.870032 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fee3e06c-b41c-4e5c-8c3a-5407d6d27eea req-6317fda9-461f-4fab-9bd0-2134906ad50b service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:01.873725 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fee3e06c-b41c-4e5c-8c3a-5407d6d27eea req-6317fda9-461f-4fab-9bd0-2134906ad50b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:01.874454 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fee3e06c-b41c-4e5c-8c3a-5407d6d27eea req-6317fda9-461f-4fab-9bd0-2134906ad50b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:01.918396 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-fee3e06c-b41c-4e5c-8c3a-5407d6d27eea req-6317fda9-461f-4fab-9bd0-2134906ad50b service nova] Creating event network-changed:8a3e4fbb-fe41-4624-9e7f-cbd92817419e for instance 855ac5ba-541c-4dc9-8a34-122679948e06 on hv-cinder-85427 Aug 24 11:26:01.931826 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-fee3e06c-b41c-4e5c-8c3a-5407d6d27eea req-6317fda9-461f-4fab-9bd0-2134906ad50b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080337 Aug 24 11:26:01.934716 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 106/213] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:23.157469 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-57661187-c229-4353-a8a9-4b48d5407399 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:23.158078 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-57661187-c229-4353-a8a9-4b48d5407399 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:23.161232 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=33 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:23.161953 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:23.167224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57661187-c229-4353-a8a9-4b48d5407399 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:23.167711 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57661187-c229-4353-a8a9-4b48d5407399 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:23.168450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57661187-c229-4353-a8a9-4b48d5407399 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:23.169445 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57661187-c229-4353-a8a9-4b48d5407399 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:23.169635 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57661187-c229-4353-a8a9-4b48d5407399 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:23.170093 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57661187-c229-4353-a8a9-4b48d5407399 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:23.194585 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-57661187-c229-4353-a8a9-4b48d5407399 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:26:23.502637 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-57661187-c229-4353-a8a9-4b48d5407399 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 204 len: 0 microversion: 2.1 time: 0.349602 Aug 24 11:26:23.503229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 108/214] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:26:23 2022] DELETE /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:26:23.508609 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=13 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:23.509435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=10 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:23.514319 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c3e2d64e-bdfc-4c50-ae4a-983271151909 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:23.515018 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c3e2d64e-bdfc-4c50-ae4a-983271151909 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:23.520930 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c3e2d64e-bdfc-4c50-ae4a-983271151909 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:23.521409 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c3e2d64e-bdfc-4c50-ae4a-983271151909 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:23.521841 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c3e2d64e-bdfc-4c50-ae4a-983271151909 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:23.522540 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c3e2d64e-bdfc-4c50-ae4a-983271151909 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:23.522992 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c3e2d64e-bdfc-4c50-ae4a-983271151909 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:23.523407 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c3e2d64e-bdfc-4c50-ae4a-983271151909 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:23.658760 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c3e2d64e-bdfc-4c50-ae4a-983271151909 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:23.667744 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c3e2d64e-bdfc-4c50-ae4a-983271151909 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1554 microversion: 2.1 time: 0.160201 Aug 24 11:26:23.668317 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 107/215] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:23 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:24.689078 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cf8f96c2-3d41-4a72-822a-2a17a6f70d8d tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:24.689780 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cf8f96c2-3d41-4a72-822a-2a17a6f70d8d tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:24.699725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf8f96c2-3d41-4a72-822a-2a17a6f70d8d tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:24.700216 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf8f96c2-3d41-4a72-822a-2a17a6f70d8d tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:24.701159 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf8f96c2-3d41-4a72-822a-2a17a6f70d8d tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:24.701847 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf8f96c2-3d41-4a72-822a-2a17a6f70d8d tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:24.702327 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf8f96c2-3d41-4a72-822a-2a17a6f70d8d tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:24.702755 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf8f96c2-3d41-4a72-822a-2a17a6f70d8d tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:24.837182 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cf8f96c2-3d41-4a72-822a-2a17a6f70d8d tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:24.845712 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cf8f96c2-3d41-4a72-822a-2a17a6f70d8d tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1554 microversion: 2.1 time: 0.160834 Aug 24 11:26:24.846419 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 109/216] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:24 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:25.866843 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-bb9e1675-9788-4023-ba18-f839689f0f93 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:25.867729 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-bb9e1675-9788-4023-ba18-f839689f0f93 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:25.873544 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb9e1675-9788-4023-ba18-f839689f0f93 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:25.874068 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb9e1675-9788-4023-ba18-f839689f0f93 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:25.874592 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb9e1675-9788-4023-ba18-f839689f0f93 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:25.875176 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb9e1675-9788-4023-ba18-f839689f0f93 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:25.875621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb9e1675-9788-4023-ba18-f839689f0f93 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:25.876036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb9e1675-9788-4023-ba18-f839689f0f93 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:26.003214 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-bb9e1675-9788-4023-ba18-f839689f0f93 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:26.011389 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-bb9e1675-9788-4023-ba18-f839689f0f93 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1554 microversion: 2.1 time: 0.148404 Aug 24 11:26:26.011969 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 108/217] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:25 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:27.032471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-85977cdf-39f3-4112-b1e7-10b524b5dc50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:27.033084 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-85977cdf-39f3-4112-b1e7-10b524b5dc50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:27.040161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85977cdf-39f3-4112-b1e7-10b524b5dc50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:27.041980 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85977cdf-39f3-4112-b1e7-10b524b5dc50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:27.041980 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85977cdf-39f3-4112-b1e7-10b524b5dc50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:27.041980 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85977cdf-39f3-4112-b1e7-10b524b5dc50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:27.042220 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85977cdf-39f3-4112-b1e7-10b524b5dc50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:27.042643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85977cdf-39f3-4112-b1e7-10b524b5dc50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:27.170485 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-85977cdf-39f3-4112-b1e7-10b524b5dc50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:27.178801 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-85977cdf-39f3-4112-b1e7-10b524b5dc50 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1554 microversion: 2.1 time: 0.150178 Aug 24 11:26:27.179373 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 110/218] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:27 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:28.200695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f3527e8e-006e-44cd-8a0a-f526eb8440d4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:28.201231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f3527e8e-006e-44cd-8a0a-f526eb8440d4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:28.207094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f3527e8e-006e-44cd-8a0a-f526eb8440d4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:28.207568 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f3527e8e-006e-44cd-8a0a-f526eb8440d4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:28.207991 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f3527e8e-006e-44cd-8a0a-f526eb8440d4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:28.208661 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f3527e8e-006e-44cd-8a0a-f526eb8440d4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:28.209105 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f3527e8e-006e-44cd-8a0a-f526eb8440d4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:28.209515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f3527e8e-006e-44cd-8a0a-f526eb8440d4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:28.342058 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f3527e8e-006e-44cd-8a0a-f526eb8440d4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:28.350280 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f3527e8e-006e-44cd-8a0a-f526eb8440d4 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1554 microversion: 2.1 time: 0.153989 Aug 24 11:26:28.350850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 109/219] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:28 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:29.370835 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5e13d2c3-b0fb-469e-9e7c-8cbe3e79d80e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:29.371450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5e13d2c3-b0fb-469e-9e7c-8cbe3e79d80e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:29.377696 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e13d2c3-b0fb-469e-9e7c-8cbe3e79d80e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:29.378224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e13d2c3-b0fb-469e-9e7c-8cbe3e79d80e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:29.378661 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e13d2c3-b0fb-469e-9e7c-8cbe3e79d80e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:29.379344 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e13d2c3-b0fb-469e-9e7c-8cbe3e79d80e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:29.379795 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e13d2c3-b0fb-469e-9e7c-8cbe3e79d80e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:29.380215 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e13d2c3-b0fb-469e-9e7c-8cbe3e79d80e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:29.507235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5e13d2c3-b0fb-469e-9e7c-8cbe3e79d80e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:29.515690 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5e13d2c3-b0fb-469e-9e7c-8cbe3e79d80e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1554 microversion: 2.1 time: 0.148687 Aug 24 11:26:29.516298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 111/220] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:29 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:30.536761 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-23a59f3f-7535-4621-99c9-37883694686e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:30.537293 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-23a59f3f-7535-4621-99c9-37883694686e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:30.544370 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-23a59f3f-7535-4621-99c9-37883694686e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:30.544884 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-23a59f3f-7535-4621-99c9-37883694686e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:30.545315 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-23a59f3f-7535-4621-99c9-37883694686e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:30.546034 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-23a59f3f-7535-4621-99c9-37883694686e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:30.546488 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-23a59f3f-7535-4621-99c9-37883694686e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:30.546914 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-23a59f3f-7535-4621-99c9-37883694686e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:30.678612 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-23a59f3f-7535-4621-99c9-37883694686e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:30.692417 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-23a59f3f-7535-4621-99c9-37883694686e tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1554 microversion: 2.1 time: 0.155220 Aug 24 11:26:30.692417 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 110/221] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:30 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:31.711232 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0ea4cf70-b299-4807-8599-2dfa759e0a5f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:31.711765 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0ea4cf70-b299-4807-8599-2dfa759e0a5f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:31.718753 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ea4cf70-b299-4807-8599-2dfa759e0a5f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:31.719251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ea4cf70-b299-4807-8599-2dfa759e0a5f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:31.719688 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ea4cf70-b299-4807-8599-2dfa759e0a5f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:31.720377 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ea4cf70-b299-4807-8599-2dfa759e0a5f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:31.720831 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ea4cf70-b299-4807-8599-2dfa759e0a5f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:31.721283 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ea4cf70-b299-4807-8599-2dfa759e0a5f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:31.858067 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0ea4cf70-b299-4807-8599-2dfa759e0a5f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:31.867076 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0ea4cf70-b299-4807-8599-2dfa759e0a5f tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1554 microversion: 2.1 time: 0.159750 Aug 24 11:26:31.867667 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 112/222] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:31 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:32.888100 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d414200a-1437-46b6-a189-a73f03cb4224 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:32.888704 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d414200a-1437-46b6-a189-a73f03cb4224 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:32.894770 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d414200a-1437-46b6-a189-a73f03cb4224 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:32.895250 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d414200a-1437-46b6-a189-a73f03cb4224 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:32.895678 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d414200a-1437-46b6-a189-a73f03cb4224 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:32.896356 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d414200a-1437-46b6-a189-a73f03cb4224 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:32.896802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d414200a-1437-46b6-a189-a73f03cb4224 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:32.897218 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d414200a-1437-46b6-a189-a73f03cb4224 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:33.032178 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d414200a-1437-46b6-a189-a73f03cb4224 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:33.040981 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d414200a-1437-46b6-a189-a73f03cb4224 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1554 microversion: 2.1 time: 0.156859 Aug 24 11:26:33.041718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 111/223] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:32 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:34.062588 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-06f1317f-a0da-4e62-9d1b-a0787f9cf269 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:34.063199 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-06f1317f-a0da-4e62-9d1b-a0787f9cf269 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:34.069843 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06f1317f-a0da-4e62-9d1b-a0787f9cf269 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:34.070367 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06f1317f-a0da-4e62-9d1b-a0787f9cf269 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:34.070838 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06f1317f-a0da-4e62-9d1b-a0787f9cf269 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:34.072025 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06f1317f-a0da-4e62-9d1b-a0787f9cf269 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:34.072834 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06f1317f-a0da-4e62-9d1b-a0787f9cf269 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:34.073580 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06f1317f-a0da-4e62-9d1b-a0787f9cf269 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:34.361841 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-06f1317f-a0da-4e62-9d1b-a0787f9cf269 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:34.370682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-06f1317f-a0da-4e62-9d1b-a0787f9cf269 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1554 microversion: 2.1 time: 0.312353 Aug 24 11:26:34.371272 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 113/224] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:34 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1554 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:34.882380 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-dd319d59-ca9e-46a0-9619-10388600a6a6 req-9c4b18da-37d5-4052-bb0b-2fd2d6d6b287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d34929-a94c-4766-bb73-021bd01bee81", "name": "network-vif-deleted", "tag": "aa887e7f-0e13-4b24-886e-ce7c3e4adc93"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:34.893351 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-dd319d59-ca9e-46a0-9619-10388600a6a6 req-9c4b18da-37d5-4052-bb0b-2fd2d6d6b287 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:34.893886 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-dd319d59-ca9e-46a0-9619-10388600a6a6 req-9c4b18da-37d5-4052-bb0b-2fd2d6d6b287 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:34.894358 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-dd319d59-ca9e-46a0-9619-10388600a6a6 req-9c4b18da-37d5-4052-bb0b-2fd2d6d6b287 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:34.908150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-dd319d59-ca9e-46a0-9619-10388600a6a6 req-9c4b18da-37d5-4052-bb0b-2fd2d6d6b287 service nova] Creating event network-vif-deleted:aa887e7f-0e13-4b24-886e-ce7c3e4adc93 for instance b8d34929-a94c-4766-bb73-021bd01bee81 on hv-cinder-85427 Aug 24 11:26:34.914066 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-dd319d59-ca9e-46a0-9619-10388600a6a6 req-9c4b18da-37d5-4052-bb0b-2fd2d6d6b287 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042638 Aug 24 11:26:34.915064 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 112/225] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:26:35.397760 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b1923f27-09e6-456e-8032-faf668c30ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:35.398397 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b1923f27-09e6-456e-8032-faf668c30ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:35.404924 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b1923f27-09e6-456e-8032-faf668c30ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:35.405407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b1923f27-09e6-456e-8032-faf668c30ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:35.405839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b1923f27-09e6-456e-8032-faf668c30ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:35.406554 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b1923f27-09e6-456e-8032-faf668c30ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:35.407012 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b1923f27-09e6-456e-8032-faf668c30ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:35.407427 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b1923f27-09e6-456e-8032-faf668c30ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:35.470329 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b1923f27-09e6-456e-8032-faf668c30ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:35.479036 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b1923f27-09e6-456e-8032-faf668c30ad9 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1346 microversion: 2.1 time: 0.085087 Aug 24 11:26:35.479727 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 114/226] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:35 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:36.499736 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d72dd2b9-f1ab-4302-968b-9bfc86a8d92b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:36.500421 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d72dd2b9-f1ab-4302-968b-9bfc86a8d92b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:36.506615 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d72dd2b9-f1ab-4302-968b-9bfc86a8d92b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:36.507087 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d72dd2b9-f1ab-4302-968b-9bfc86a8d92b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:36.507541 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d72dd2b9-f1ab-4302-968b-9bfc86a8d92b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:36.508217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d72dd2b9-f1ab-4302-968b-9bfc86a8d92b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:36.508655 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d72dd2b9-f1ab-4302-968b-9bfc86a8d92b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:36.509064 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d72dd2b9-f1ab-4302-968b-9bfc86a8d92b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:36.541239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d72dd2b9-f1ab-4302-968b-9bfc86a8d92b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:36.541721 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d72dd2b9-f1ab-4302-968b-9bfc86a8d92b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:36.542299 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d72dd2b9-f1ab-4302-968b-9bfc86a8d92b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:36.542752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-d72dd2b9-f1ab-4302-968b-9bfc86a8d92b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lazy-loading 'fault' on Instance uuid b8d34929-a94c-4766-bb73-021bd01bee81 {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:26:36.611216 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d72dd2b9-f1ab-4302-968b-9bfc86a8d92b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa39f218d4d463291ffe15b929c4e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4b6d46119374e6ab76032a4db1198d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:36.619716 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d72dd2b9-f1ab-4302-968b-9bfc86a8d92b tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 200 len: 1305 microversion: 2.1 time: 0.124257 Aug 24 11:26:36.623926 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 113/227] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:36 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 1305 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:37.641648 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-091619ee-3c1f-43e2-8445-a91d0ab3d8aa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:37.642277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-091619ee-3c1f-43e2-8445-a91d0ab3d8aa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:37.648709 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-091619ee-3c1f-43e2-8445-a91d0ab3d8aa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:37.649194 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-091619ee-3c1f-43e2-8445-a91d0ab3d8aa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:37.649622 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-091619ee-3c1f-43e2-8445-a91d0ab3d8aa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:37.650496 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-091619ee-3c1f-43e2-8445-a91d0ab3d8aa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:37.650941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-091619ee-3c1f-43e2-8445-a91d0ab3d8aa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:37.651357 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-091619ee-3c1f-43e2-8445-a91d0ab3d8aa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:37.667307 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-091619ee-3c1f-43e2-8445-a91d0ab3d8aa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] HTTP exception thrown: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-091619ee-3c1f-43e2-8445-a91d0ab3d8aa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Request method failure captured: Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 HTTP/1.1 Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgqEgnBjkCTzsPvFNj_nRwEjfXSeJNzv-FJ83G8rW2a9cgtXVzsPkokP1wiPG2K6qWpqwJ5PRKJ2DYMFDqWGzncFyoIjzSO-NKFUm4bXG5T3qYI-GSDeatGNu9ztdAolNinsTtb_HUCASXjlZi-FVudIbOlUnDstm9mHIXcPhSh3_g4 Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: b4b6d46119374e6ab76032a4db1198d5 Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-DeleteServersTestJSON-892320406 Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:26:37.672000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:26:37.673551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b4b6d46119374e6ab76032a4db1198d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b4b6d46119374e6ab76032a4db1198d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b4b6d46119374e6ab76032a4db1198d5", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b4b6d46119374e6ab76032a4db1198d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:26:37.673551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-DeleteServersTestJSON-892320406 Aug 24 11:26:37.673551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: b4b6d46119374e6ab76032a4db1198d5 Aug 24 11:26:37.673551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-DeleteServersTestJSON-892320406 Aug 24 11:26:37.673551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-DeleteServersTestJSON-892320406-project Aug 24 11:26:37.673551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:26:37.673551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:26:37.673551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 4aa39f218d4d463291ffe15b929c4e2d Aug 24 11:26:37.673551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-DeleteServersTestJSON-892320406-project Aug 24 11:26:37.673551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:26:37.673551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:37.673551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': 'b8d34929-a94c-4766-bb73-021bd01bee81'} Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:26:37.674394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:37.675691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:26:37.677613 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-091619ee-3c1f-43e2-8445-a91d0ab3d8aa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Returning 404 to user: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:26:37.678564 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-091619ee-3c1f-43e2-8445-a91d0ab3d8aa tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 404 len: 111 microversion: 2.1 time: 0.041422 Aug 24 11:26:37.679113 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 115/228] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:37 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:26:37.812360 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1145f341-812f-4400-b895-d4936c2ae01c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:37.814523 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1145f341-812f-4400-b895-d4936c2ae01c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:37.820619 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1145f341-812f-4400-b895-d4936c2ae01c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:37.821109 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1145f341-812f-4400-b895-d4936c2ae01c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:37.821544 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1145f341-812f-4400-b895-d4936c2ae01c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:37.830658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1145f341-812f-4400-b895-d4936c2ae01c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:37.830658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1145f341-812f-4400-b895-d4936c2ae01c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:37.830658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1145f341-812f-4400-b895-d4936c2ae01c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:37.836375 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-1145f341-812f-4400-b895-d4936c2ae01c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] HTTP exception thrown: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1145f341-812f-4400-b895-d4936c2ae01c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Request method failure captured: Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81/os-volume_attachments HTTP/1.1 Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgqEgnBjkCTzsPvFNj_nRwEjfXSeJNzv-FJ83G8rW2a9cgtXVzsPkokP1wiPG2K6qWpqwJ5PRKJ2DYMFDqWGzncFyoIjzSO-NKFUm4bXG5T3qYI-GSDeatGNu9ztdAolNinsTtb_HUCASXjlZi-FVudIbOlUnDstm9mHIXcPhSh3_g4 Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: b4b6d46119374e6ab76032a4db1198d5 Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-DeleteServersTestJSON-892320406 Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:26:37.852363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:26:37.860934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b4b6d46119374e6ab76032a4db1198d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b4b6d46119374e6ab76032a4db1198d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b4b6d46119374e6ab76032a4db1198d5", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b4b6d46119374e6ab76032a4db1198d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:26:37.860934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-DeleteServersTestJSON-892320406 Aug 24 11:26:37.860934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: b4b6d46119374e6ab76032a4db1198d5 Aug 24 11:26:37.860934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-DeleteServersTestJSON-892320406 Aug 24 11:26:37.860934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-DeleteServersTestJSON-892320406-project Aug 24 11:26:37.860934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:26:37.860934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:26:37.860934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 4aa39f218d4d463291ffe15b929c4e2d Aug 24 11:26:37.860934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-DeleteServersTestJSON-892320406-project Aug 24 11:26:37.860934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:26:37.860934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:37.860934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'server_id': 'b8d34929-a94c-4766-bb73-021bd01bee81'} Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:26:37.862050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:37.863349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:26:37.864886 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1145f341-812f-4400-b895-d4936c2ae01c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Returning 404 to user: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:26:37.864886 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1145f341-812f-4400-b895-d4936c2ae01c tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046349 Aug 24 11:26:37.864886 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 114/229] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:26:37 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:26:43.606132 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a4622221-27cf-498c-a2ef-61e55ced6477 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:43.607391 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a4622221-27cf-498c-a2ef-61e55ced6477 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:43.614198 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4622221-27cf-498c-a2ef-61e55ced6477 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:43.614670 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4622221-27cf-498c-a2ef-61e55ced6477 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:43.615093 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4622221-27cf-498c-a2ef-61e55ced6477 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:43.615919 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4622221-27cf-498c-a2ef-61e55ced6477 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:43.616362 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4622221-27cf-498c-a2ef-61e55ced6477 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:43.616782 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4622221-27cf-498c-a2ef-61e55ced6477 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:43.630953 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-a4622221-27cf-498c-a2ef-61e55ced6477 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] HTTP exception thrown: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a4622221-27cf-498c-a2ef-61e55ced6477 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Request method failure captured: Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 HTTP/1.1 Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgqEgnBjkCTzsPvFNj_nRwEjfXSeJNzv-FJ83G8rW2a9cgtXVzsPkokP1wiPG2K6qWpqwJ5PRKJ2DYMFDqWGzncFyoIjzSO-NKFUm4bXG5T3qYI-GSDeatGNu9ztdAolNinsTtb_HUCASXjlZi-FVudIbOlUnDstm9mHIXcPhSh3_g4 Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: b4b6d46119374e6ab76032a4db1198d5 Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-DeleteServersTestJSON-892320406 Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:26:43.632481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:26:43.633716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b4b6d46119374e6ab76032a4db1198d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b4b6d46119374e6ab76032a4db1198d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b4b6d46119374e6ab76032a4db1198d5", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b4b6d46119374e6ab76032a4db1198d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:26:43.633716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-DeleteServersTestJSON-892320406 Aug 24 11:26:43.633716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: b4b6d46119374e6ab76032a4db1198d5 Aug 24 11:26:43.633716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-DeleteServersTestJSON-892320406 Aug 24 11:26:43.633716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-DeleteServersTestJSON-892320406-project Aug 24 11:26:43.633716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:26:43.633716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:26:43.633716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 4aa39f218d4d463291ffe15b929c4e2d Aug 24 11:26:43.633716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-DeleteServersTestJSON-892320406-project Aug 24 11:26:43.633716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:26:43.633716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:43.633716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': 'b8d34929-a94c-4766-bb73-021bd01bee81'} Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:26:43.634407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:43.635589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:26:43.636713 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a4622221-27cf-498c-a2ef-61e55ced6477 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Returning 404 to user: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:26:43.636713 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a4622221-27cf-498c-a2ef-61e55ced6477 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 404 len: 111 microversion: 2.1 time: 0.031579 Aug 24 11:26:43.636713 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 116/230] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:26:43 2022] DELETE /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:26:43.642948 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6b47ef9a-4cd2-4e87-8dcc-12d03441baa0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:43.643718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6b47ef9a-4cd2-4e87-8dcc-12d03441baa0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] [instance: b8d34929-a94c-4766-bb73-021bd01bee81] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:43.649841 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b47ef9a-4cd2-4e87-8dcc-12d03441baa0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:43.650434 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b47ef9a-4cd2-4e87-8dcc-12d03441baa0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:43.650873 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b47ef9a-4cd2-4e87-8dcc-12d03441baa0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:43.651620 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b47ef9a-4cd2-4e87-8dcc-12d03441baa0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:43.652076 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b47ef9a-4cd2-4e87-8dcc-12d03441baa0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:43.652544 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b47ef9a-4cd2-4e87-8dcc-12d03441baa0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:43.676462 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-6b47ef9a-4cd2-4e87-8dcc-12d03441baa0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] HTTP exception thrown: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6b47ef9a-4cd2-4e87-8dcc-12d03441baa0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Request method failure captured: Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 HTTP/1.1 Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgqEgnBjkCTzsPvFNj_nRwEjfXSeJNzv-FJ83G8rW2a9cgtXVzsPkokP1wiPG2K6qWpqwJ5PRKJ2DYMFDqWGzncFyoIjzSO-NKFUm4bXG5T3qYI-GSDeatGNu9ztdAolNinsTtb_HUCASXjlZi-FVudIbOlUnDstm9mHIXcPhSh3_g4 Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: b4b6d46119374e6ab76032a4db1198d5 Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-DeleteServersTestJSON-892320406 Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:26:43.678754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:26:43.680156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b4b6d46119374e6ab76032a4db1198d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b4b6d46119374e6ab76032a4db1198d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b4b6d46119374e6ab76032a4db1198d5", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b4b6d46119374e6ab76032a4db1198d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:26:43.680156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-DeleteServersTestJSON-892320406 Aug 24 11:26:43.680156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: b4b6d46119374e6ab76032a4db1198d5 Aug 24 11:26:43.680156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-DeleteServersTestJSON-892320406 Aug 24 11:26:43.680156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-DeleteServersTestJSON-892320406-project Aug 24 11:26:43.680156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:26:43.680156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:26:43.680156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 4aa39f218d4d463291ffe15b929c4e2d Aug 24 11:26:43.680156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-DeleteServersTestJSON-892320406-project Aug 24 11:26:43.680156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:26:43.680156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:43.680156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': 'b8d34929-a94c-4766-bb73-021bd01bee81'} Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:26:43.680925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. Aug 24 11:26:43.682251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:26:43.683384 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6b47ef9a-4cd2-4e87-8dcc-12d03441baa0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] Returning 404 to user: Instance b8d34929-a94c-4766-bb73-021bd01bee81 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:26:43.683384 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6b47ef9a-4cd2-4e87-8dcc-12d03441baa0 tempest-DeleteServersTestJSON-892320406 tempest-DeleteServersTestJSON-892320406-project] 10.222.0.83 "GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81" status: 404 len: 111 microversion: 2.1 time: 0.041377 Aug 24 11:26:43.683384 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 115/231] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:43 2022] GET /compute/v2.1/servers/b8d34929-a94c-4766-bb73-021bd01bee81 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:26:56.636324 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:56.639282 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:56.949588 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-860953701", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:57.042610 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] validate_networks() for [('666ed928-684f-494a-bff2-a438190969d7', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:26:57.692190 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:26:57.692836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:26:57.693111 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:26:57.693587 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:26:57.694069 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:26:57.703674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.705156 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.705824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:57.706784 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:57.707248 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:57.707674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:57.726597 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Getting quotas for project e2a13f3ca60643a9a3507476325d351a. Resources: {'cores', 'instances', 'ram'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:26:57.731058 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Getting quotas for user 57be68e76fc14d2ca309571e284509bd and project e2a13f3ca60643a9a3507476325d351a. Resources: {'cores', 'instances', 'ram'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:26:57.747773 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:26:57.750016 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:26:57.862373 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-53c9eb53-14e6-4ce0-819f-0f8899a49075 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.234935 Aug 24 11:26:57.863028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 117/232] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:26:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:26:57.874970 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9665bab9-4c55-4eef-88c6-07b3a643ad12 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:57.875636 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9665bab9-4c55-4eef-88c6-07b3a643ad12 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:57.880909 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=20 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:57.881561 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=44 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:26:57.940170 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9665bab9-4c55-4eef-88c6-07b3a643ad12 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:57.947690 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9665bab9-4c55-4eef-88c6-07b3a643ad12 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1221 microversion: 2.1 time: 0.077432 Aug 24 11:26:57.948373 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 116/233] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:57 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:26:58.110559 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1961768979", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:26:58.227589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] validate_networks() for [('666ed928-684f-494a-bff2-a438190969d7', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:26:58.815311 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:26:58.816492 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:26:58.818903 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:26:58.820134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:26:58.822664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:26:58.836229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.837003 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.837653 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.838756 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:26:58.839663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:26:58.840334 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:26:58.862581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Getting quotas for project e2a13f3ca60643a9a3507476325d351a. Resources: {'cores', 'instances', 'ram'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:26:58.867466 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Getting quotas for user 57be68e76fc14d2ca309571e284509bd and project e2a13f3ca60643a9a3507476325d351a. Resources: {'cores', 'instances', 'ram'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:26:58.883131 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:26:58.888235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:26:59.207019 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-78ea149f-1a03-46de-aba0-b00013eff4be tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.101772 Aug 24 11:26:59.216628 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 118/234] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:26:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:26:59.219458 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-285eaf20-f7ae-4313-9202-0adeb14a1a8a tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:26:59.220032 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-285eaf20-f7ae-4313-9202-0adeb14a1a8a tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:26:59.331702 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-285eaf20-f7ae-4313-9202-0adeb14a1a8a tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:26:59.341860 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-285eaf20-f7ae-4313-9202-0adeb14a1a8a tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1222 microversion: 2.1 time: 0.127145 Aug 24 11:26:59.342414 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 117/235] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:26:59 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:00.365510 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e7d76cdd-639b-4ae6-a062-ecdaeb0c6499 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:00.365510 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e7d76cdd-639b-4ae6-a062-ecdaeb0c6499 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:00.434359 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e7d76cdd-639b-4ae6-a062-ecdaeb0c6499 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:00.441484 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e7d76cdd-639b-4ae6-a062-ecdaeb0c6499 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1222 microversion: 2.1 time: 0.082595 Aug 24 11:27:00.442127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 119/236] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:00 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:01.463183 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-88406aa5-6983-414d-99a5-c52ed9a55d53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:01.465253 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-88406aa5-6983-414d-99a5-c52ed9a55d53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:01.474827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-88406aa5-6983-414d-99a5-c52ed9a55d53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:01.475333 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-88406aa5-6983-414d-99a5-c52ed9a55d53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:01.475762 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-88406aa5-6983-414d-99a5-c52ed9a55d53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:01.476464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-88406aa5-6983-414d-99a5-c52ed9a55d53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:01.481664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-88406aa5-6983-414d-99a5-c52ed9a55d53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:01.484975 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-88406aa5-6983-414d-99a5-c52ed9a55d53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:01.599733 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-88406aa5-6983-414d-99a5-c52ed9a55d53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:01.608279 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-88406aa5-6983-414d-99a5-c52ed9a55d53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1274 microversion: 2.1 time: 0.149545 Aug 24 11:27:01.608897 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 118/237] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:01 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:02.631687 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-32f728c1-626a-45d9-9479-7c71feba8824 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:02.632316 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-32f728c1-626a-45d9-9479-7c71feba8824 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:02.639629 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32f728c1-626a-45d9-9479-7c71feba8824 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:02.640807 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32f728c1-626a-45d9-9479-7c71feba8824 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:02.641493 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32f728c1-626a-45d9-9479-7c71feba8824 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:02.642929 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32f728c1-626a-45d9-9479-7c71feba8824 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:02.643663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32f728c1-626a-45d9-9479-7c71feba8824 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:02.644317 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32f728c1-626a-45d9-9479-7c71feba8824 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:02.715127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-32f728c1-626a-45d9-9479-7c71feba8824 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:02.723508 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-32f728c1-626a-45d9-9479-7c71feba8824 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1280 microversion: 2.1 time: 0.095786 Aug 24 11:27:02.724091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 120/238] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:02 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1280 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:03.747312 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e46d9bba-3fd1-40ef-9d6f-f36a95513211 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:03.748024 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e46d9bba-3fd1-40ef-9d6f-f36a95513211 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:03.763073 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e46d9bba-3fd1-40ef-9d6f-f36a95513211 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:03.763853 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e46d9bba-3fd1-40ef-9d6f-f36a95513211 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:03.764443 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e46d9bba-3fd1-40ef-9d6f-f36a95513211 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:03.765311 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e46d9bba-3fd1-40ef-9d6f-f36a95513211 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:03.765923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e46d9bba-3fd1-40ef-9d6f-f36a95513211 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:03.766487 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e46d9bba-3fd1-40ef-9d6f-f36a95513211 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:04.155422 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-c4964f12-79c8-4395-9323-c532df26329f req-54b8366f-a76d-4e83-a5c4-6c1c8e260307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939", "tag": "30d8bd12-3adf-4f5f-a775-86e909be5297"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:04.166361 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-c4964f12-79c8-4395-9323-c532df26329f req-54b8366f-a76d-4e83-a5c4-6c1c8e260307 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:04.166817 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-c4964f12-79c8-4395-9323-c532df26329f req-54b8366f-a76d-4e83-a5c4-6c1c8e260307 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:04.167231 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-c4964f12-79c8-4395-9323-c532df26329f req-54b8366f-a76d-4e83-a5c4-6c1c8e260307 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:04.179161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-c4964f12-79c8-4395-9323-c532df26329f req-54b8366f-a76d-4e83-a5c4-6c1c8e260307 service nova] Creating event network-changed:30d8bd12-3adf-4f5f-a775-86e909be5297 for instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 on hv-cinder-85427 Aug 24 11:27:04.184239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-c4964f12-79c8-4395-9323-c532df26329f req-54b8366f-a76d-4e83-a5c4-6c1c8e260307 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033062 Aug 24 11:27:04.184845 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 121/239] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:04.192516 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e46d9bba-3fd1-40ef-9d6f-f36a95513211 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:04.206502 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e46d9bba-3fd1-40ef-9d6f-f36a95513211 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.462800 Aug 24 11:27:04.209302 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 119/240] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:03 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:05.230188 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a1201e34-2f62-47ea-9a11-32e596fa62a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:05.231585 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a1201e34-2f62-47ea-9a11-32e596fa62a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:05.240967 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1201e34-2f62-47ea-9a11-32e596fa62a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:05.243128 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1201e34-2f62-47ea-9a11-32e596fa62a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:05.244693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1201e34-2f62-47ea-9a11-32e596fa62a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:05.245243 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1201e34-2f62-47ea-9a11-32e596fa62a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:05.248706 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1201e34-2f62-47ea-9a11-32e596fa62a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:05.249235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1201e34-2f62-47ea-9a11-32e596fa62a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:05.260773 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-a3f095c9-40c1-497c-bdde-c4527310f3fa req-bb37a14d-2a3b-4b05-900e-566d73355256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "686e0b3f-da08-4b12-b376-c7f3f88474b8", "tag": "6ee951d1-6e63-41c2-9f51-717bd126d0f5"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:05.278483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-a3f095c9-40c1-497c-bdde-c4527310f3fa req-bb37a14d-2a3b-4b05-900e-566d73355256 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:05.279231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-a3f095c9-40c1-497c-bdde-c4527310f3fa req-bb37a14d-2a3b-4b05-900e-566d73355256 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:05.279545 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-a3f095c9-40c1-497c-bdde-c4527310f3fa req-bb37a14d-2a3b-4b05-900e-566d73355256 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:05.307002 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-a3f095c9-40c1-497c-bdde-c4527310f3fa req-bb37a14d-2a3b-4b05-900e-566d73355256 service nova] Creating event network-changed:6ee951d1-6e63-41c2-9f51-717bd126d0f5 for instance 686e0b3f-da08-4b12-b376-c7f3f88474b8 on hv-cinder-85427 Aug 24 11:27:05.321062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-a3f095c9-40c1-497c-bdde-c4527310f3fa req-bb37a14d-2a3b-4b05-900e-566d73355256 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064698 Aug 24 11:27:05.322954 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 120/241] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:27:05.539182 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a1201e34-2f62-47ea-9a11-32e596fa62a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:05.548234 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a1201e34-2f62-47ea-9a11-32e596fa62a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.322172 Aug 24 11:27:05.548890 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 122/242] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:05 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:06.576779 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9402251d-f07e-489c-bb2c-92bd79577916 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:06.577487 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9402251d-f07e-489c-bb2c-92bd79577916 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:06.586024 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9402251d-f07e-489c-bb2c-92bd79577916 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:06.586795 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9402251d-f07e-489c-bb2c-92bd79577916 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:06.587457 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9402251d-f07e-489c-bb2c-92bd79577916 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:06.588407 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9402251d-f07e-489c-bb2c-92bd79577916 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:06.588933 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9402251d-f07e-489c-bb2c-92bd79577916 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:06.590211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9402251d-f07e-489c-bb2c-92bd79577916 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:06.765322 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9402251d-f07e-489c-bb2c-92bd79577916 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:06.774425 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9402251d-f07e-489c-bb2c-92bd79577916 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.208089 Aug 24 11:27:06.788786 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 121/243] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:06 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:07.796038 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-85468de9-92c5-43c9-913f-409857fd4f2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:07.804126 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-85468de9-92c5-43c9-913f-409857fd4f2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:07.804332 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85468de9-92c5-43c9-913f-409857fd4f2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:07.804877 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85468de9-92c5-43c9-913f-409857fd4f2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:07.805497 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85468de9-92c5-43c9-913f-409857fd4f2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:07.806493 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85468de9-92c5-43c9-913f-409857fd4f2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:07.807163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85468de9-92c5-43c9-913f-409857fd4f2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:07.807591 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85468de9-92c5-43c9-913f-409857fd4f2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:08.099928 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-85468de9-92c5-43c9-913f-409857fd4f2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:08.107741 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-85468de9-92c5-43c9-913f-409857fd4f2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.316064 Aug 24 11:27:08.108337 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 123/244] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:07 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:09.064344 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1456982621", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "networks": [{"uuid": "7614d6c9-7ae0-4d40-863d-d15c9e8c60f3"}]}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:09.142591 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b347f815-58dd-4d4f-a1ba-5f1482f2ea7f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:09.142591 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b347f815-58dd-4d4f-a1ba-5f1482f2ea7f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:09.143535 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] validate_networks() for [('7614d6c9-7ae0-4d40-863d-d15c9e8c60f3', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:27:09.143614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=4 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:09.144674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b347f815-58dd-4d4f-a1ba-5f1482f2ea7f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:09.145352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b347f815-58dd-4d4f-a1ba-5f1482f2ea7f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:09.146005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b347f815-58dd-4d4f-a1ba-5f1482f2ea7f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:09.146930 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b347f815-58dd-4d4f-a1ba-5f1482f2ea7f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:09.147564 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b347f815-58dd-4d4f-a1ba-5f1482f2ea7f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:09.148160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b347f815-58dd-4d4f-a1ba-5f1482f2ea7f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:09.297675 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b347f815-58dd-4d4f-a1ba-5f1482f2ea7f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:09.306339 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b347f815-58dd-4d4f-a1ba-5f1482f2ea7f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.177208 Aug 24 11:27:09.306986 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 124/245] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:09 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:09.337217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=4 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:09.551622 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:27:09.552114 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:27:09.552582 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:27:09.552984 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:27:09.553389 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:27:09.563232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:09.563705 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:09.564155 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:09.564883 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:09.565324 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:09.565736 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:09.584561 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Getting quotas for project a1b8e9dbce62475eaa97dbad91fcd910. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:27:09.590330 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Getting quotas for user 8a512d59d7b4477b88f7bb9532141d06 and project a1b8e9dbce62475eaa97dbad91fcd910. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:27:09.601103 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:27:09.603620 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:27:09.761587 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-fc1f955b-051e-455a-9a4b-8e696f7f30b3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701843 Aug 24 11:27:09.768037 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 122/246] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:27:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:27:09.773124 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-53f28d4c-3c53-483f-81d2-580e69db03b5 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:09.773914 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-53f28d4c-3c53-483f-81d2-580e69db03b5 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:09.828494 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-53f28d4c-3c53-483f-81d2-580e69db03b5 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:09.838330 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-53f28d4c-3c53-483f-81d2-580e69db03b5 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1214 microversion: 2.1 time: 0.068993 Aug 24 11:27:09.852722 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 125/247] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:09 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:10.327610 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-189dbf5b-c76b-4b0b-ae61-728843338ae1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:10.328220 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-189dbf5b-c76b-4b0b-ae61-728843338ae1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:10.347891 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-189dbf5b-c76b-4b0b-ae61-728843338ae1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:10.348386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-189dbf5b-c76b-4b0b-ae61-728843338ae1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:10.348853 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-189dbf5b-c76b-4b0b-ae61-728843338ae1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:10.349557 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-189dbf5b-c76b-4b0b-ae61-728843338ae1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:10.351540 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-189dbf5b-c76b-4b0b-ae61-728843338ae1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:10.353915 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-189dbf5b-c76b-4b0b-ae61-728843338ae1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:10.550923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-189dbf5b-c76b-4b0b-ae61-728843338ae1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:10.559629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-189dbf5b-c76b-4b0b-ae61-728843338ae1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.236390 Aug 24 11:27:10.566432 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 123/248] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:10 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:10.860099 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-58b11c91-40d0-41a5-b40a-fe76630b8bf8 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:10.860897 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-58b11c91-40d0-41a5-b40a-fe76630b8bf8 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:10.926795 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-58b11c91-40d0-41a5-b40a-fe76630b8bf8 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:10.937996 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-58b11c91-40d0-41a5-b40a-fe76630b8bf8 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1214 microversion: 2.1 time: 0.078992 Aug 24 11:27:10.939410 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 126/249] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:10 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:11.580865 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e663e322-0407-4ca9-a38a-f87d04a15678 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:11.581394 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e663e322-0407-4ca9-a38a-f87d04a15678 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:11.588218 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e663e322-0407-4ca9-a38a-f87d04a15678 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:11.588706 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e663e322-0407-4ca9-a38a-f87d04a15678 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:11.589694 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e663e322-0407-4ca9-a38a-f87d04a15678 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:11.590934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e663e322-0407-4ca9-a38a-f87d04a15678 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:11.591580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e663e322-0407-4ca9-a38a-f87d04a15678 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:11.592053 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e663e322-0407-4ca9-a38a-f87d04a15678 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:11.810453 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-85300139-461c-41eb-b840-ea753a61c9c7 req-3dd330b5-806c-4058-89c1-4671ca2c7df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939", "name": "network-vif-plugged", "status": "completed", "tag": "30d8bd12-3adf-4f5f-a775-86e909be5297"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:11.826786 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e663e322-0407-4ca9-a38a-f87d04a15678 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:11.829460 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-85300139-461c-41eb-b840-ea753a61c9c7 req-3dd330b5-806c-4058-89c1-4671ca2c7df2 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:11.829963 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-85300139-461c-41eb-b840-ea753a61c9c7 req-3dd330b5-806c-4058-89c1-4671ca2c7df2 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:11.830550 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-85300139-461c-41eb-b840-ea753a61c9c7 req-3dd330b5-806c-4058-89c1-4671ca2c7df2 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:11.837185 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e663e322-0407-4ca9-a38a-f87d04a15678 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.260255 Aug 24 11:27:11.838217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 124/250] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:11 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:11.859420 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-85300139-461c-41eb-b840-ea753a61c9c7 req-3dd330b5-806c-4058-89c1-4671ca2c7df2 service nova] Creating event network-vif-plugged:30d8bd12-3adf-4f5f-a775-86e909be5297 for instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 on hv-cinder-85427 Aug 24 11:27:11.865345 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-85300139-461c-41eb-b840-ea753a61c9c7 req-3dd330b5-806c-4058-89c1-4671ca2c7df2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059606 Aug 24 11:27:11.867097 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 127/251] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:27:11.955732 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9b7ef6c5-8247-4484-8d50-6e7127139efa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:11.956417 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9b7ef6c5-8247-4484-8d50-6e7127139efa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:11.967129 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b7ef6c5-8247-4484-8d50-6e7127139efa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:11.973347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b7ef6c5-8247-4484-8d50-6e7127139efa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:11.973347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b7ef6c5-8247-4484-8d50-6e7127139efa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:11.973347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b7ef6c5-8247-4484-8d50-6e7127139efa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:11.973347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b7ef6c5-8247-4484-8d50-6e7127139efa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:11.973840 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b7ef6c5-8247-4484-8d50-6e7127139efa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:12.091578 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9b7ef6c5-8247-4484-8d50-6e7127139efa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:12.119820 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9b7ef6c5-8247-4484-8d50-6e7127139efa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1210 microversion: 2.1 time: 0.168161 Aug 24 11:27:12.122907 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 125/252] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:11 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1210 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:12.860999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-05837e6b-e2e8-44d9-9178-c125a41b95c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:12.862046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-05837e6b-e2e8-44d9-9178-c125a41b95c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:12.872876 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05837e6b-e2e8-44d9-9178-c125a41b95c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:12.873509 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05837e6b-e2e8-44d9-9178-c125a41b95c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:12.873797 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05837e6b-e2e8-44d9-9178-c125a41b95c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:12.874704 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05837e6b-e2e8-44d9-9178-c125a41b95c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:12.875279 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05837e6b-e2e8-44d9-9178-c125a41b95c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:12.875592 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05837e6b-e2e8-44d9-9178-c125a41b95c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:13.052772 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-05837e6b-e2e8-44d9-9178-c125a41b95c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:13.064035 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-05837e6b-e2e8-44d9-9178-c125a41b95c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.207011 Aug 24 11:27:13.065302 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 128/253] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:12 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:13.152991 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-439e3453-9d03-48a0-8ec1-64841b5261da tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:13.153605 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-439e3453-9d03-48a0-8ec1-64841b5261da tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:13.161121 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-439e3453-9d03-48a0-8ec1-64841b5261da tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:13.171544 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-439e3453-9d03-48a0-8ec1-64841b5261da tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:13.171544 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-439e3453-9d03-48a0-8ec1-64841b5261da tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:13.171544 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-439e3453-9d03-48a0-8ec1-64841b5261da tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:13.171544 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-439e3453-9d03-48a0-8ec1-64841b5261da tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:13.172019 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-439e3453-9d03-48a0-8ec1-64841b5261da tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:13.241011 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-439e3453-9d03-48a0-8ec1-64841b5261da tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:13.249400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-439e3453-9d03-48a0-8ec1-64841b5261da tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1266 microversion: 2.1 time: 0.100734 Aug 24 11:27:13.249988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 126/254] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:13 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:14.085982 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0db744c4-0c69-4d30-94a1-ba51a1e28843 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:14.086605 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0db744c4-0c69-4d30-94a1-ba51a1e28843 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:14.096465 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0db744c4-0c69-4d30-94a1-ba51a1e28843 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:14.096970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0db744c4-0c69-4d30-94a1-ba51a1e28843 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:14.097562 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0db744c4-0c69-4d30-94a1-ba51a1e28843 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:14.098356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0db744c4-0c69-4d30-94a1-ba51a1e28843 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:14.098853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0db744c4-0c69-4d30-94a1-ba51a1e28843 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:14.099368 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0db744c4-0c69-4d30-94a1-ba51a1e28843 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:14.270245 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3aba3965-ae77-422a-bad1-84e15c169841 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:14.270967 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3aba3965-ae77-422a-bad1-84e15c169841 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:14.278346 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3aba3965-ae77-422a-bad1-84e15c169841 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:14.286777 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3aba3965-ae77-422a-bad1-84e15c169841 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:14.292789 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3aba3965-ae77-422a-bad1-84e15c169841 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:14.293896 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3aba3965-ae77-422a-bad1-84e15c169841 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:14.294520 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3aba3965-ae77-422a-bad1-84e15c169841 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:14.295097 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3aba3965-ae77-422a-bad1-84e15c169841 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:14.371968 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0db744c4-0c69-4d30-94a1-ba51a1e28843 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:14.392708 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0db744c4-0c69-4d30-94a1-ba51a1e28843 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.306937 Aug 24 11:27:14.393836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 129/255] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:14 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:14.430617 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3aba3965-ae77-422a-bad1-84e15c169841 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:14.447970 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3aba3965-ae77-422a-bad1-84e15c169841 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1284 microversion: 2.1 time: 0.180918 Aug 24 11:27:14.450948 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 127/256] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:14 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:15.412768 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7df87f84-7c8f-44a4-b4d5-d9c3e857a1aa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:15.414117 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7df87f84-7c8f-44a4-b4d5-d9c3e857a1aa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:15.420970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7df87f84-7c8f-44a4-b4d5-d9c3e857a1aa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:15.421707 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7df87f84-7c8f-44a4-b4d5-d9c3e857a1aa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:15.422339 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7df87f84-7c8f-44a4-b4d5-d9c3e857a1aa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:15.424169 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7df87f84-7c8f-44a4-b4d5-d9c3e857a1aa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:15.424169 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7df87f84-7c8f-44a4-b4d5-d9c3e857a1aa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:15.424169 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7df87f84-7c8f-44a4-b4d5-d9c3e857a1aa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:15.488973 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-423af297-5fa7-454d-a8b7-813664650e17 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:15.489738 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-423af297-5fa7-454d-a8b7-813664650e17 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:15.496075 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-423af297-5fa7-454d-a8b7-813664650e17 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:15.498730 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-423af297-5fa7-454d-a8b7-813664650e17 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:15.499534 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-423af297-5fa7-454d-a8b7-813664650e17 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:15.504543 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-423af297-5fa7-454d-a8b7-813664650e17 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:15.504543 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-423af297-5fa7-454d-a8b7-813664650e17 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:15.504543 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-423af297-5fa7-454d-a8b7-813664650e17 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:15.615832 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7df87f84-7c8f-44a4-b4d5-d9c3e857a1aa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:15.624144 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7df87f84-7c8f-44a4-b4d5-d9c3e857a1aa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.215392 Aug 24 11:27:15.637417 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 130/257] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:15 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:15.656104 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-423af297-5fa7-454d-a8b7-813664650e17 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:15.664323 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-423af297-5fa7-454d-a8b7-813664650e17 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.179503 Aug 24 11:27:15.665031 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 128/258] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:15 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:15.986531 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-afb4f60d-fe0c-42d9-ae69-208da8e36503 req-07056f9f-017a-46fa-b2f9-a69b6172beab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e245ee8-79ab-4ab1-a25d-01c3d304358a", "tag": "59b4abb9-64c6-4cc1-8b75-4d9b880a9c2d"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:15.996047 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-afb4f60d-fe0c-42d9-ae69-208da8e36503 req-07056f9f-017a-46fa-b2f9-a69b6172beab service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:15.997038 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-afb4f60d-fe0c-42d9-ae69-208da8e36503 req-07056f9f-017a-46fa-b2f9-a69b6172beab service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:15.997603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-afb4f60d-fe0c-42d9-ae69-208da8e36503 req-07056f9f-017a-46fa-b2f9-a69b6172beab service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:16.013225 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-afb4f60d-fe0c-42d9-ae69-208da8e36503 req-07056f9f-017a-46fa-b2f9-a69b6172beab service nova] Creating event network-changed:59b4abb9-64c6-4cc1-8b75-4d9b880a9c2d for instance 2e245ee8-79ab-4ab1-a25d-01c3d304358a on hv-cinder-85427 Aug 24 11:27:16.018231 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-afb4f60d-fe0c-42d9-ae69-208da8e36503 req-07056f9f-017a-46fa-b2f9-a69b6172beab service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035437 Aug 24 11:27:16.018838 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 131/259] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:16.153521 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-b9012c20-461b-4f54-be1d-f9d96de13815 req-aa304c05-cd7f-4f2c-946c-04f29b43d134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686e0b3f-da08-4b12-b376-c7f3f88474b8", "name": "network-vif-plugged", "status": "completed", "tag": "6ee951d1-6e63-41c2-9f51-717bd126d0f5"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:16.163798 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-b9012c20-461b-4f54-be1d-f9d96de13815 req-aa304c05-cd7f-4f2c-946c-04f29b43d134 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:16.164282 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-b9012c20-461b-4f54-be1d-f9d96de13815 req-aa304c05-cd7f-4f2c-946c-04f29b43d134 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:16.164713 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-b9012c20-461b-4f54-be1d-f9d96de13815 req-aa304c05-cd7f-4f2c-946c-04f29b43d134 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:16.178315 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-b9012c20-461b-4f54-be1d-f9d96de13815 req-aa304c05-cd7f-4f2c-946c-04f29b43d134 service nova] Creating event network-vif-plugged:6ee951d1-6e63-41c2-9f51-717bd126d0f5 for instance 686e0b3f-da08-4b12-b376-c7f3f88474b8 on hv-cinder-85427 Aug 24 11:27:16.181761 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-b9012c20-461b-4f54-be1d-f9d96de13815 req-aa304c05-cd7f-4f2c-946c-04f29b43d134 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032244 Aug 24 11:27:16.182397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 129/260] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:16.644584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-826f9999-0814-43b3-a035-e4f680e7bbaf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:16.648324 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-826f9999-0814-43b3-a035-e4f680e7bbaf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:16.654315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-826f9999-0814-43b3-a035-e4f680e7bbaf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:16.655161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-826f9999-0814-43b3-a035-e4f680e7bbaf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:16.655593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-826f9999-0814-43b3-a035-e4f680e7bbaf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:16.656298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-826f9999-0814-43b3-a035-e4f680e7bbaf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:16.656751 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-826f9999-0814-43b3-a035-e4f680e7bbaf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:16.657225 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-826f9999-0814-43b3-a035-e4f680e7bbaf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:16.695594 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3fe42e7a-d5cd-40e4-81e6-ef5dd2a49863 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:16.696347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3fe42e7a-d5cd-40e4-81e6-ef5dd2a49863 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:16.703344 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fe42e7a-d5cd-40e4-81e6-ef5dd2a49863 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:16.703971 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fe42e7a-d5cd-40e4-81e6-ef5dd2a49863 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:16.704463 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fe42e7a-d5cd-40e4-81e6-ef5dd2a49863 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:16.711391 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fe42e7a-d5cd-40e4-81e6-ef5dd2a49863 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:16.711391 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fe42e7a-d5cd-40e4-81e6-ef5dd2a49863 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:16.711391 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fe42e7a-d5cd-40e4-81e6-ef5dd2a49863 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:16.850296 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-826f9999-0814-43b3-a035-e4f680e7bbaf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:16.862805 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-826f9999-0814-43b3-a035-e4f680e7bbaf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.222366 Aug 24 11:27:16.864045 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 132/261] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:16 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:16.880354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3fe42e7a-d5cd-40e4-81e6-ef5dd2a49863 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:16.888562 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3fe42e7a-d5cd-40e4-81e6-ef5dd2a49863 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.199323 Aug 24 11:27:16.889150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 130/262] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:16 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:17.884264 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4003bd1a-c7c6-4cb8-9942-53f14132d985 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:17.884875 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4003bd1a-c7c6-4cb8-9942-53f14132d985 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:17.891720 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4003bd1a-c7c6-4cb8-9942-53f14132d985 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:17.892203 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4003bd1a-c7c6-4cb8-9942-53f14132d985 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:17.892640 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4003bd1a-c7c6-4cb8-9942-53f14132d985 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:17.893381 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4003bd1a-c7c6-4cb8-9942-53f14132d985 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:17.893831 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4003bd1a-c7c6-4cb8-9942-53f14132d985 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:17.894278 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4003bd1a-c7c6-4cb8-9942-53f14132d985 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:17.910296 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-381184f1-bd54-4100-9530-8112c068e3e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:17.910916 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-381184f1-bd54-4100-9530-8112c068e3e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:17.916852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-381184f1-bd54-4100-9530-8112c068e3e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:17.917341 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-381184f1-bd54-4100-9530-8112c068e3e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:17.917796 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-381184f1-bd54-4100-9530-8112c068e3e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:17.918510 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-381184f1-bd54-4100-9530-8112c068e3e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:17.918964 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-381184f1-bd54-4100-9530-8112c068e3e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:17.920808 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-381184f1-bd54-4100-9530-8112c068e3e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:18.073292 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-381184f1-bd54-4100-9530-8112c068e3e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:18.081911 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-381184f1-bd54-4100-9530-8112c068e3e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.175754 Aug 24 11:27:18.082712 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 131/263] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:17 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:18.101073 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4003bd1a-c7c6-4cb8-9942-53f14132d985 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:18.109165 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4003bd1a-c7c6-4cb8-9942-53f14132d985 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.228658 Aug 24 11:27:18.109669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 133/264] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:17 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:19.102658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-097bd29e-4a93-4152-8000-bf55b11a9f5d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:19.103273 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-097bd29e-4a93-4152-8000-bf55b11a9f5d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:19.109226 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-097bd29e-4a93-4152-8000-bf55b11a9f5d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:19.109700 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-097bd29e-4a93-4152-8000-bf55b11a9f5d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:19.110170 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-097bd29e-4a93-4152-8000-bf55b11a9f5d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:19.110850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-097bd29e-4a93-4152-8000-bf55b11a9f5d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:19.111296 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-097bd29e-4a93-4152-8000-bf55b11a9f5d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:19.111710 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-097bd29e-4a93-4152-8000-bf55b11a9f5d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:19.129611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e0609ba4-fcad-465c-b961-85b18dc9f652 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:19.130251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e0609ba4-fcad-465c-b961-85b18dc9f652 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:19.137139 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0609ba4-fcad-465c-b961-85b18dc9f652 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:19.137629 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0609ba4-fcad-465c-b961-85b18dc9f652 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:19.138100 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0609ba4-fcad-465c-b961-85b18dc9f652 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:19.138793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0609ba4-fcad-465c-b961-85b18dc9f652 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:19.139248 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0609ba4-fcad-465c-b961-85b18dc9f652 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:19.139671 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0609ba4-fcad-465c-b961-85b18dc9f652 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:19.241439 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-097bd29e-4a93-4152-8000-bf55b11a9f5d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:19.249291 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-097bd29e-4a93-4152-8000-bf55b11a9f5d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.150443 Aug 24 11:27:19.249889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 132/265] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:19 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:19.275711 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e0609ba4-fcad-465c-b961-85b18dc9f652 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:19.285214 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e0609ba4-fcad-465c-b961-85b18dc9f652 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.159089 Aug 24 11:27:19.285810 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 134/266] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:19 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:20.272686 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-41f68611-40b9-414e-8faf-c2e3b655a678 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:20.273275 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-41f68611-40b9-414e-8faf-c2e3b655a678 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:20.275213 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:20.280549 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-41f68611-40b9-414e-8faf-c2e3b655a678 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:20.281042 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-41f68611-40b9-414e-8faf-c2e3b655a678 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:20.281476 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-41f68611-40b9-414e-8faf-c2e3b655a678 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:20.282193 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-41f68611-40b9-414e-8faf-c2e3b655a678 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:20.282649 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-41f68611-40b9-414e-8faf-c2e3b655a678 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:20.283095 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-41f68611-40b9-414e-8faf-c2e3b655a678 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:20.304557 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8c64dbf5-686e-4cc6-8f94-35bdaa0a3f6d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:20.305161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8c64dbf5-686e-4cc6-8f94-35bdaa0a3f6d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:20.312429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c64dbf5-686e-4cc6-8f94-35bdaa0a3f6d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:20.312913 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c64dbf5-686e-4cc6-8f94-35bdaa0a3f6d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:20.313343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c64dbf5-686e-4cc6-8f94-35bdaa0a3f6d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:20.314642 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c64dbf5-686e-4cc6-8f94-35bdaa0a3f6d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:20.315115 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c64dbf5-686e-4cc6-8f94-35bdaa0a3f6d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:20.315553 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c64dbf5-686e-4cc6-8f94-35bdaa0a3f6d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:20.355498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=6 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:20.438798 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-41f68611-40b9-414e-8faf-c2e3b655a678 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:20.446920 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-41f68611-40b9-414e-8faf-c2e3b655a678 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.178955 Aug 24 11:27:20.458293 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 133/267] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:20 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:20.462323 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8c64dbf5-686e-4cc6-8f94-35bdaa0a3f6d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:20.470388 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8c64dbf5-686e-4cc6-8f94-35bdaa0a3f6d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.169515 Aug 24 11:27:20.470968 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 135/268] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:20 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:21.469354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6601f94e-2776-4f67-be21-3860323e6aa9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:21.475127 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6601f94e-2776-4f67-be21-3860323e6aa9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:21.476810 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6601f94e-2776-4f67-be21-3860323e6aa9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:21.477273 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6601f94e-2776-4f67-be21-3860323e6aa9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:21.477710 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6601f94e-2776-4f67-be21-3860323e6aa9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:21.478435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6601f94e-2776-4f67-be21-3860323e6aa9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:21.478888 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6601f94e-2776-4f67-be21-3860323e6aa9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:21.479311 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6601f94e-2776-4f67-be21-3860323e6aa9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:21.490626 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1db2db91-55d5-4b4f-951b-ede97630b2c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:21.491243 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1db2db91-55d5-4b4f-951b-ede97630b2c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:21.494349 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=18 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:21.498983 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1db2db91-55d5-4b4f-951b-ede97630b2c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:21.503795 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1db2db91-55d5-4b4f-951b-ede97630b2c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:21.503795 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1db2db91-55d5-4b4f-951b-ede97630b2c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:21.503795 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1db2db91-55d5-4b4f-951b-ede97630b2c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:21.503795 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1db2db91-55d5-4b4f-951b-ede97630b2c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:21.504141 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1db2db91-55d5-4b4f-951b-ede97630b2c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:21.614967 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6601f94e-2776-4f67-be21-3860323e6aa9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:21.623211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6601f94e-2776-4f67-be21-3860323e6aa9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.158515 Aug 24 11:27:21.623777 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 134/269] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:21 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:21.632516 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1db2db91-55d5-4b4f-951b-ede97630b2c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:21.640314 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1db2db91-55d5-4b4f-951b-ede97630b2c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.153494 Aug 24 11:27:21.640883 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 136/270] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:21 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:22.644922 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2680eb6f-d793-4de4-a534-574f0377aa32 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:22.646016 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-2680eb6f-d793-4de4-a534-574f0377aa32 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:22.653096 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2680eb6f-d793-4de4-a534-574f0377aa32 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:22.653580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2680eb6f-d793-4de4-a534-574f0377aa32 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:22.654055 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2680eb6f-d793-4de4-a534-574f0377aa32 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:22.654751 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2680eb6f-d793-4de4-a534-574f0377aa32 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:22.655202 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2680eb6f-d793-4de4-a534-574f0377aa32 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:22.655622 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2680eb6f-d793-4de4-a534-574f0377aa32 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:22.663718 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-49406503-c404-4ba6-8cbb-bb7e21eaede9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:22.668484 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-49406503-c404-4ba6-8cbb-bb7e21eaede9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:22.672114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49406503-c404-4ba6-8cbb-bb7e21eaede9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:22.672608 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49406503-c404-4ba6-8cbb-bb7e21eaede9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:22.673050 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49406503-c404-4ba6-8cbb-bb7e21eaede9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:22.673751 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49406503-c404-4ba6-8cbb-bb7e21eaede9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:22.674234 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49406503-c404-4ba6-8cbb-bb7e21eaede9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:22.674655 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49406503-c404-4ba6-8cbb-bb7e21eaede9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:22.830508 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-2680eb6f-d793-4de4-a534-574f0377aa32 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:22.840612 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-2680eb6f-d793-4de4-a534-574f0377aa32 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.200121 Aug 24 11:27:22.841230 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 135/271] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:22 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:22.842128 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-49406503-c404-4ba6-8cbb-bb7e21eaede9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:22.851208 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-49406503-c404-4ba6-8cbb-bb7e21eaede9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.191541 Aug 24 11:27:22.852131 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 137/272] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:22 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:23.861997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-54cf7854-928e-443e-a3dd-f653a3621e08 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:23.862606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-54cf7854-928e-443e-a3dd-f653a3621e08 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:23.868790 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-54cf7854-928e-443e-a3dd-f653a3621e08 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:23.869275 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-54cf7854-928e-443e-a3dd-f653a3621e08 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:23.869706 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-54cf7854-928e-443e-a3dd-f653a3621e08 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:23.870420 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-54cf7854-928e-443e-a3dd-f653a3621e08 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:23.871492 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-54cf7854-928e-443e-a3dd-f653a3621e08 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:23.871909 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-54cf7854-928e-443e-a3dd-f653a3621e08 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:23.872258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c9f54ac1-37f4-42f0-8268-2a2b4752ec24 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:23.872966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c9f54ac1-37f4-42f0-8268-2a2b4752ec24 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:23.879486 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c9f54ac1-37f4-42f0-8268-2a2b4752ec24 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:23.879974 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c9f54ac1-37f4-42f0-8268-2a2b4752ec24 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:23.880408 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c9f54ac1-37f4-42f0-8268-2a2b4752ec24 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:23.881098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c9f54ac1-37f4-42f0-8268-2a2b4752ec24 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:23.881596 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c9f54ac1-37f4-42f0-8268-2a2b4752ec24 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:23.882063 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c9f54ac1-37f4-42f0-8268-2a2b4752ec24 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:23.890361 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=100 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:24.011389 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-54cf7854-928e-443e-a3dd-f653a3621e08 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:24.013156 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c9f54ac1-37f4-42f0-8268-2a2b4752ec24 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:24.019128 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-54cf7854-928e-443e-a3dd-f653a3621e08 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.160943 Aug 24 11:27:24.019716 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 136/273] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:23 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:24.020982 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c9f54ac1-37f4-42f0-8268-2a2b4752ec24 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.153126 Aug 24 11:27:24.021562 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 138/274] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:23 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:25.043740 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-20399444-ef90-4c4a-9a08-64055d8a9812 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:25.044637 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-20399444-ef90-4c4a-9a08-64055d8a9812 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:25.045494 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-26180f5c-b5b6-4c77-b36a-2cabc1ee26c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:25.046692 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-26180f5c-b5b6-4c77-b36a-2cabc1ee26c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:25.054002 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-20399444-ef90-4c4a-9a08-64055d8a9812 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:25.054777 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-20399444-ef90-4c4a-9a08-64055d8a9812 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:25.055511 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-20399444-ef90-4c4a-9a08-64055d8a9812 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:25.056747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-20399444-ef90-4c4a-9a08-64055d8a9812 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:25.057032 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26180f5c-b5b6-4c77-b36a-2cabc1ee26c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:25.057390 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-20399444-ef90-4c4a-9a08-64055d8a9812 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:25.057813 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26180f5c-b5b6-4c77-b36a-2cabc1ee26c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:25.058740 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-20399444-ef90-4c4a-9a08-64055d8a9812 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:25.059068 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26180f5c-b5b6-4c77-b36a-2cabc1ee26c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:25.060161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26180f5c-b5b6-4c77-b36a-2cabc1ee26c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:25.060911 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26180f5c-b5b6-4c77-b36a-2cabc1ee26c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:25.061611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26180f5c-b5b6-4c77-b36a-2cabc1ee26c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:25.201516 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-26180f5c-b5b6-4c77-b36a-2cabc1ee26c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:25.201935 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-20399444-ef90-4c4a-9a08-64055d8a9812 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:25.205250 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:25.209789 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-20399444-ef90-4c4a-9a08-64055d8a9812 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.172877 Aug 24 11:27:25.210396 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-26180f5c-b5b6-4c77-b36a-2cabc1ee26c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.171914 Aug 24 11:27:25.213596 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 137/275] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:25 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:25.213910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 139/276] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:25 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:26.231332 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f9b8bf7c-407d-4de1-bdcf-e3cd65c46c25 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:26.232018 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f9b8bf7c-407d-4de1-bdcf-e3cd65c46c25 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:26.238181 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f9b8bf7c-407d-4de1-bdcf-e3cd65c46c25 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:26.238666 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f9b8bf7c-407d-4de1-bdcf-e3cd65c46c25 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:26.239116 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f9b8bf7c-407d-4de1-bdcf-e3cd65c46c25 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:26.239610 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-79bd4ee2-18fa-47c5-81cc-f2321d571c74 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:26.240063 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f9b8bf7c-407d-4de1-bdcf-e3cd65c46c25 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:26.240274 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f9b8bf7c-407d-4de1-bdcf-e3cd65c46c25 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:26.240398 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-79bd4ee2-18fa-47c5-81cc-f2321d571c74 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:26.240694 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f9b8bf7c-407d-4de1-bdcf-e3cd65c46c25 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:26.248616 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79bd4ee2-18fa-47c5-81cc-f2321d571c74 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:26.249318 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79bd4ee2-18fa-47c5-81cc-f2321d571c74 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:26.250637 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79bd4ee2-18fa-47c5-81cc-f2321d571c74 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:26.250637 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79bd4ee2-18fa-47c5-81cc-f2321d571c74 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:26.251199 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79bd4ee2-18fa-47c5-81cc-f2321d571c74 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:26.251626 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79bd4ee2-18fa-47c5-81cc-f2321d571c74 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:26.431986 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f9b8bf7c-407d-4de1-bdcf-e3cd65c46c25 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:26.441354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f9b8bf7c-407d-4de1-bdcf-e3cd65c46c25 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.213962 Aug 24 11:27:26.456118 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 138/277] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:26 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:26.458950 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-79bd4ee2-18fa-47c5-81cc-f2321d571c74 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:26.468019 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-79bd4ee2-18fa-47c5-81cc-f2321d571c74 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1322 microversion: 2.1 time: 0.232715 Aug 24 11:27:26.468892 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 140/278] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:26 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:27.461611 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4314e713-da32-4b96-98b9-475c1e716b04 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:27.462395 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4314e713-da32-4b96-98b9-475c1e716b04 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:27.470645 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4314e713-da32-4b96-98b9-475c1e716b04 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:27.471237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4314e713-da32-4b96-98b9-475c1e716b04 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:27.471774 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4314e713-da32-4b96-98b9-475c1e716b04 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:27.472550 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4314e713-da32-4b96-98b9-475c1e716b04 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:27.473083 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4314e713-da32-4b96-98b9-475c1e716b04 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:27.473574 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4314e713-da32-4b96-98b9-475c1e716b04 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:27.489694 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-76fa1537-ef62-4a7b-a947-5ac3ee627514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:27.490988 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-76fa1537-ef62-4a7b-a947-5ac3ee627514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:27.510328 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76fa1537-ef62-4a7b-a947-5ac3ee627514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:27.511249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76fa1537-ef62-4a7b-a947-5ac3ee627514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:27.511887 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76fa1537-ef62-4a7b-a947-5ac3ee627514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:27.512605 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76fa1537-ef62-4a7b-a947-5ac3ee627514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:27.513280 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76fa1537-ef62-4a7b-a947-5ac3ee627514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:27.513708 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76fa1537-ef62-4a7b-a947-5ac3ee627514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:27.687907 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4314e713-da32-4b96-98b9-475c1e716b04 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:27.694013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-76fa1537-ef62-4a7b-a947-5ac3ee627514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:27.699938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4314e713-da32-4b96-98b9-475c1e716b04 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.239487 Aug 24 11:27:27.705584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-76fa1537-ef62-4a7b-a947-5ac3ee627514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1516 microversion: 2.1 time: 0.219884 Aug 24 11:27:27.713089 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 141/279] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:27 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1516 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:27.713260 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 139/280] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:27 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:27.725953 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8710713c-6b63-4608-a7cb-cf08213d5e29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:27.728138 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8710713c-6b63-4608-a7cb-cf08213d5e29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:27.736189 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8710713c-6b63-4608-a7cb-cf08213d5e29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:27.736189 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8710713c-6b63-4608-a7cb-cf08213d5e29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:27.736189 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8710713c-6b63-4608-a7cb-cf08213d5e29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:27.736698 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8710713c-6b63-4608-a7cb-cf08213d5e29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:27.736896 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8710713c-6b63-4608-a7cb-cf08213d5e29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:27.737306 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8710713c-6b63-4608-a7cb-cf08213d5e29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:27.761319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-8710713c-6b63-4608-a7cb-cf08213d5e29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lazy-loading 'flavor' on Instance uuid 686e0b3f-da08-4b12-b376-c7f3f88474b8 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:27:28.190834 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8710713c-6b63-4608-a7cb-cf08213d5e29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "POST /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8/action" status: 200 len: 32 microversion: 2.1 time: 0.468560 Aug 24 11:27:28.191559 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 142/281] 10.222.0.83 () {60 vars in 1278 bytes} [Wed Aug 24 11:27:27 2022] POST /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8/action => generated 32 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:27:28.202265 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9a48e9a6-4828-479b-9308-ae626f126230 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:28.202979 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9a48e9a6-4828-479b-9308-ae626f126230 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:28.209477 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9a48e9a6-4828-479b-9308-ae626f126230 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:28.209997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9a48e9a6-4828-479b-9308-ae626f126230 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:28.210462 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9a48e9a6-4828-479b-9308-ae626f126230 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:28.211305 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9a48e9a6-4828-479b-9308-ae626f126230 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:28.211760 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9a48e9a6-4828-479b-9308-ae626f126230 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:28.212212 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9a48e9a6-4828-479b-9308-ae626f126230 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:28.403753 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9a48e9a6-4828-479b-9308-ae626f126230 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:28.403753 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9a48e9a6-4828-479b-9308-ae626f126230 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.190153 Aug 24 11:27:28.403753 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 140/282] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:28 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:28.720448 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a6efc6b1-2cec-49ac-884b-3de2eb706b8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:28.721395 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a6efc6b1-2cec-49ac-884b-3de2eb706b8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:28.723644 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:28.729430 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6efc6b1-2cec-49ac-884b-3de2eb706b8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:28.730485 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6efc6b1-2cec-49ac-884b-3de2eb706b8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:28.730917 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6efc6b1-2cec-49ac-884b-3de2eb706b8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:28.731613 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6efc6b1-2cec-49ac-884b-3de2eb706b8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:28.732055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6efc6b1-2cec-49ac-884b-3de2eb706b8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:28.732469 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6efc6b1-2cec-49ac-884b-3de2eb706b8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:28.952509 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a6efc6b1-2cec-49ac-884b-3de2eb706b8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:28.960249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a6efc6b1-2cec-49ac-884b-3de2eb706b8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.244615 Aug 24 11:27:28.960916 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 143/283] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:28 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:29.409200 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8b600620-f3fb-41e3-9dad-086d2de46013 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:29.410120 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8b600620-f3fb-41e3-9dad-086d2de46013 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:29.412028 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:29.416705 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8b600620-f3fb-41e3-9dad-086d2de46013 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:29.417198 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8b600620-f3fb-41e3-9dad-086d2de46013 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:29.418328 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8b600620-f3fb-41e3-9dad-086d2de46013 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:29.418938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8b600620-f3fb-41e3-9dad-086d2de46013 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:29.419396 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8b600620-f3fb-41e3-9dad-086d2de46013 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:29.419822 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8b600620-f3fb-41e3-9dad-086d2de46013 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:29.552210 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8b600620-f3fb-41e3-9dad-086d2de46013 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:29.560505 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8b600620-f3fb-41e3-9dad-086d2de46013 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.155271 Aug 24 11:27:29.561139 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 141/284] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:29 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:29.981823 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-96607804-1b27-442a-8aac-5969d4caf368 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:29.982460 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-96607804-1b27-442a-8aac-5969d4caf368 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:29.988891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96607804-1b27-442a-8aac-5969d4caf368 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:29.989378 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96607804-1b27-442a-8aac-5969d4caf368 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:29.989814 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96607804-1b27-442a-8aac-5969d4caf368 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:29.990725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96607804-1b27-442a-8aac-5969d4caf368 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:29.991188 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96607804-1b27-442a-8aac-5969d4caf368 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:29.991639 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96607804-1b27-442a-8aac-5969d4caf368 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:30.306889 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-96607804-1b27-442a-8aac-5969d4caf368 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:30.315512 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-96607804-1b27-442a-8aac-5969d4caf368 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.338490 Aug 24 11:27:30.332611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 144/285] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:29 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:30.466304 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-c241dd6f-bd7e-4af8-a425-ba05aafad2e9 req-05bc7e21-edeb-4c18-a561-c94ffd34cc33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e245ee8-79ab-4ab1-a25d-01c3d304358a", "name": "network-vif-plugged", "status": "completed", "tag": "59b4abb9-64c6-4cc1-8b75-4d9b880a9c2d"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:30.476122 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-c241dd6f-bd7e-4af8-a425-ba05aafad2e9 req-05bc7e21-edeb-4c18-a561-c94ffd34cc33 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:30.476607 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-c241dd6f-bd7e-4af8-a425-ba05aafad2e9 req-05bc7e21-edeb-4c18-a561-c94ffd34cc33 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:30.477070 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-c241dd6f-bd7e-4af8-a425-ba05aafad2e9 req-05bc7e21-edeb-4c18-a561-c94ffd34cc33 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:30.489093 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-c241dd6f-bd7e-4af8-a425-ba05aafad2e9 req-05bc7e21-edeb-4c18-a561-c94ffd34cc33 service nova] Creating event network-vif-plugged:59b4abb9-64c6-4cc1-8b75-4d9b880a9c2d for instance 2e245ee8-79ab-4ab1-a25d-01c3d304358a on hv-cinder-85427 Aug 24 11:27:30.494552 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-c241dd6f-bd7e-4af8-a425-ba05aafad2e9 req-05bc7e21-edeb-4c18-a561-c94ffd34cc33 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032302 Aug 24 11:27:30.495328 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 142/286] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:30.580903 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1b83eeb9-bc5e-4375-b338-20b18cbcf6f6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:30.581594 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1b83eeb9-bc5e-4375-b338-20b18cbcf6f6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:30.589118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b83eeb9-bc5e-4375-b338-20b18cbcf6f6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:30.590727 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b83eeb9-bc5e-4375-b338-20b18cbcf6f6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:30.591922 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b83eeb9-bc5e-4375-b338-20b18cbcf6f6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:30.593327 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b83eeb9-bc5e-4375-b338-20b18cbcf6f6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:30.595079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b83eeb9-bc5e-4375-b338-20b18cbcf6f6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:30.600830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b83eeb9-bc5e-4375-b338-20b18cbcf6f6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:30.759884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1b83eeb9-bc5e-4375-b338-20b18cbcf6f6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:30.767775 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1b83eeb9-bc5e-4375-b338-20b18cbcf6f6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.191008 Aug 24 11:27:30.768461 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 145/287] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:30 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:31.343886 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f41f4df4-d971-42ae-9bff-275591ecf90b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:31.344582 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f41f4df4-d971-42ae-9bff-275591ecf90b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:31.371842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f41f4df4-d971-42ae-9bff-275591ecf90b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.371842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f41f4df4-d971-42ae-9bff-275591ecf90b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.371842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f41f4df4-d971-42ae-9bff-275591ecf90b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.371842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f41f4df4-d971-42ae-9bff-275591ecf90b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.372277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f41f4df4-d971-42ae-9bff-275591ecf90b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.372277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f41f4df4-d971-42ae-9bff-275591ecf90b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.491888 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f41f4df4-d971-42ae-9bff-275591ecf90b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:31.501496 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f41f4df4-d971-42ae-9bff-275591ecf90b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.163604 Aug 24 11:27:31.502103 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 143/288] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:31 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:31.794197 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f6470c2d-5cc8-444c-b19a-fe72eaec55b2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:31.794821 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f6470c2d-5cc8-444c-b19a-fe72eaec55b2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:31.801925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f6470c2d-5cc8-444c-b19a-fe72eaec55b2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.802421 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f6470c2d-5cc8-444c-b19a-fe72eaec55b2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.803047 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f6470c2d-5cc8-444c-b19a-fe72eaec55b2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.803935 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f6470c2d-5cc8-444c-b19a-fe72eaec55b2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:31.804401 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f6470c2d-5cc8-444c-b19a-fe72eaec55b2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:31.804824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f6470c2d-5cc8-444c-b19a-fe72eaec55b2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:31.951978 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f6470c2d-5cc8-444c-b19a-fe72eaec55b2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:31.959887 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f6470c2d-5cc8-444c-b19a-fe72eaec55b2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.172708 Aug 24 11:27:31.960526 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 146/289] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:31 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:32.528198 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-eb037569-d46b-4b42-91b6-03855932b15b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:32.529069 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-eb037569-d46b-4b42-91b6-03855932b15b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:32.536349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb037569-d46b-4b42-91b6-03855932b15b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:32.536973 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb037569-d46b-4b42-91b6-03855932b15b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:32.537631 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb037569-d46b-4b42-91b6-03855932b15b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:32.538421 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb037569-d46b-4b42-91b6-03855932b15b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:32.538934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb037569-d46b-4b42-91b6-03855932b15b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:32.539416 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb037569-d46b-4b42-91b6-03855932b15b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:32.705675 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-eb037569-d46b-4b42-91b6-03855932b15b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:32.713436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-eb037569-d46b-4b42-91b6-03855932b15b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.190251 Aug 24 11:27:32.722004 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 144/290] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:32 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:32.980874 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9691f2aa-5074-4873-8849-337528e9bf76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:32.981585 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9691f2aa-5074-4873-8849-337528e9bf76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:32.988703 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9691f2aa-5074-4873-8849-337528e9bf76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:32.989191 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9691f2aa-5074-4873-8849-337528e9bf76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:32.989623 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9691f2aa-5074-4873-8849-337528e9bf76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:32.990377 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9691f2aa-5074-4873-8849-337528e9bf76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:32.990827 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9691f2aa-5074-4873-8849-337528e9bf76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:32.991247 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9691f2aa-5074-4873-8849-337528e9bf76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:33.325316 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9691f2aa-5074-4873-8849-337528e9bf76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:33.333705 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9691f2aa-5074-4873-8849-337528e9bf76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.356888 Aug 24 11:27:33.334365 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 147/291] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:32 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:33.735127 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1bdd62e2-8850-4869-be4c-75988fe04db9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:33.735605 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1bdd62e2-8850-4869-be4c-75988fe04db9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:33.743595 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1bdd62e2-8850-4869-be4c-75988fe04db9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:33.744096 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1bdd62e2-8850-4869-be4c-75988fe04db9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:33.744536 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1bdd62e2-8850-4869-be4c-75988fe04db9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:33.745807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1bdd62e2-8850-4869-be4c-75988fe04db9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:33.746295 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1bdd62e2-8850-4869-be4c-75988fe04db9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:33.746727 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1bdd62e2-8850-4869-be4c-75988fe04db9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:33.900821 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1bdd62e2-8850-4869-be4c-75988fe04db9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:33.910066 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1bdd62e2-8850-4869-be4c-75988fe04db9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.179058 Aug 24 11:27:33.910859 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 145/292] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:33 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:34.355689 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a5ece9cc-77ca-49c6-b9af-7cb67d416e37 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:34.356298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a5ece9cc-77ca-49c6-b9af-7cb67d416e37 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:34.362957 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a5ece9cc-77ca-49c6-b9af-7cb67d416e37 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:34.363439 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a5ece9cc-77ca-49c6-b9af-7cb67d416e37 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:34.363866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a5ece9cc-77ca-49c6-b9af-7cb67d416e37 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:34.364556 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a5ece9cc-77ca-49c6-b9af-7cb67d416e37 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:34.365003 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a5ece9cc-77ca-49c6-b9af-7cb67d416e37 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:34.365423 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a5ece9cc-77ca-49c6-b9af-7cb67d416e37 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:34.633298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a5ece9cc-77ca-49c6-b9af-7cb67d416e37 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:34.645137 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a5ece9cc-77ca-49c6-b9af-7cb67d416e37 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.293819 Aug 24 11:27:34.645959 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 148/293] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:34 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:34.932450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-16fddd30-10ea-4859-83be-16fc44ca042d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:34.934371 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-16fddd30-10ea-4859-83be-16fc44ca042d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:34.940962 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-16fddd30-10ea-4859-83be-16fc44ca042d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:34.941654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-16fddd30-10ea-4859-83be-16fc44ca042d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:34.942116 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-16fddd30-10ea-4859-83be-16fc44ca042d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:34.942815 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-16fddd30-10ea-4859-83be-16fc44ca042d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:34.943264 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-16fddd30-10ea-4859-83be-16fc44ca042d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:34.943690 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-16fddd30-10ea-4859-83be-16fc44ca042d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:35.126279 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-16fddd30-10ea-4859-83be-16fc44ca042d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:35.139032 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-16fddd30-10ea-4859-83be-16fc44ca042d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.210348 Aug 24 11:27:35.144472 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 146/294] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:34 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:35.666391 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ab8537e4-5d95-413d-bb3a-342bb0f3b5e3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:35.667518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ab8537e4-5d95-413d-bb3a-342bb0f3b5e3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:35.674171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ab8537e4-5d95-413d-bb3a-342bb0f3b5e3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:35.675129 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ab8537e4-5d95-413d-bb3a-342bb0f3b5e3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:35.675263 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ab8537e4-5d95-413d-bb3a-342bb0f3b5e3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:35.675974 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ab8537e4-5d95-413d-bb3a-342bb0f3b5e3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:35.676425 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ab8537e4-5d95-413d-bb3a-342bb0f3b5e3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:35.677228 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ab8537e4-5d95-413d-bb3a-342bb0f3b5e3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.110788 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ab8537e4-5d95-413d-bb3a-342bb0f3b5e3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:36.119097 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ab8537e4-5d95-413d-bb3a-342bb0f3b5e3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.456492 Aug 24 11:27:36.119834 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 149/295] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:35 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:36.161666 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9e796044-211b-4ab6-8c3a-7a8e85ebcada tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:36.162904 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9e796044-211b-4ab6-8c3a-7a8e85ebcada tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:36.173007 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e796044-211b-4ab6-8c3a-7a8e85ebcada tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.174516 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e796044-211b-4ab6-8c3a-7a8e85ebcada tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.175123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e796044-211b-4ab6-8c3a-7a8e85ebcada tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.176000 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e796044-211b-4ab6-8c3a-7a8e85ebcada tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:36.176797 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e796044-211b-4ab6-8c3a-7a8e85ebcada tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:36.177591 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e796044-211b-4ab6-8c3a-7a8e85ebcada tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:36.483376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9e796044-211b-4ab6-8c3a-7a8e85ebcada tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:36.493059 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9e796044-211b-4ab6-8c3a-7a8e85ebcada tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.335880 Aug 24 11:27:36.493287 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 147/296] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:36 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:37.141393 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-19afa029-535d-4060-8c83-779d09a972c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:37.142750 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-19afa029-535d-4060-8c83-779d09a972c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:37.149591 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19afa029-535d-4060-8c83-779d09a972c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:37.150295 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19afa029-535d-4060-8c83-779d09a972c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:37.150695 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19afa029-535d-4060-8c83-779d09a972c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:37.151979 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19afa029-535d-4060-8c83-779d09a972c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:37.152475 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19afa029-535d-4060-8c83-779d09a972c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:37.152900 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19afa029-535d-4060-8c83-779d09a972c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:37.316403 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-19afa029-535d-4060-8c83-779d09a972c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:37.347922 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-19afa029-535d-4060-8c83-779d09a972c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.207833 Aug 24 11:27:37.348559 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 150/297] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:37 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:37.517143 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-541d2767-4b33-4bea-9b05-544c36f056ff tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:37.517742 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-541d2767-4b33-4bea-9b05-544c36f056ff tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:37.523903 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-541d2767-4b33-4bea-9b05-544c36f056ff tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:37.524523 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-541d2767-4b33-4bea-9b05-544c36f056ff tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:37.525232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-541d2767-4b33-4bea-9b05-544c36f056ff tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:37.525678 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-541d2767-4b33-4bea-9b05-544c36f056ff tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:37.526709 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-541d2767-4b33-4bea-9b05-544c36f056ff tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:37.527127 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-541d2767-4b33-4bea-9b05-544c36f056ff tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:37.773747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-541d2767-4b33-4bea-9b05-544c36f056ff tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:37.783120 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-541d2767-4b33-4bea-9b05-544c36f056ff tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1314 microversion: 2.1 time: 0.269775 Aug 24 11:27:37.784289 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 148/298] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:37 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:38.371756 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-51a48439-22a1-41b4-bd2f-86dbff1ed17e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:38.376762 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-51a48439-22a1-41b4-bd2f-86dbff1ed17e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:38.383868 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a48439-22a1-41b4-bd2f-86dbff1ed17e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.384370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a48439-22a1-41b4-bd2f-86dbff1ed17e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.384937 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a48439-22a1-41b4-bd2f-86dbff1ed17e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.386259 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a48439-22a1-41b4-bd2f-86dbff1ed17e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.386941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a48439-22a1-41b4-bd2f-86dbff1ed17e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.387381 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a48439-22a1-41b4-bd2f-86dbff1ed17e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.643841 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-51a48439-22a1-41b4-bd2f-86dbff1ed17e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:38.652529 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-51a48439-22a1-41b4-bd2f-86dbff1ed17e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.287013 Aug 24 11:27:38.653081 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 151/299] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:38 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:38.805621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3cb5e782-364b-4d23-b7d3-b22adfa75bd7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:38.806389 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3cb5e782-364b-4d23-b7d3-b22adfa75bd7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:38.814798 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3cb5e782-364b-4d23-b7d3-b22adfa75bd7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.817080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3cb5e782-364b-4d23-b7d3-b22adfa75bd7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.817648 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3cb5e782-364b-4d23-b7d3-b22adfa75bd7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.818623 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3cb5e782-364b-4d23-b7d3-b22adfa75bd7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:38.819206 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3cb5e782-364b-4d23-b7d3-b22adfa75bd7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:38.819875 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3cb5e782-364b-4d23-b7d3-b22adfa75bd7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:38.964747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3cb5e782-364b-4d23-b7d3-b22adfa75bd7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:38.973028 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3cb5e782-364b-4d23-b7d3-b22adfa75bd7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1497 microversion: 2.1 time: 0.172158 Aug 24 11:27:38.973574 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 149/300] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:38 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:39.674473 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cd266e20-9cd1-4fb9-b2ce-09ae7048be5f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:39.675128 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cd266e20-9cd1-4fb9-b2ce-09ae7048be5f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:39.682474 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cd266e20-9cd1-4fb9-b2ce-09ae7048be5f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:39.683485 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cd266e20-9cd1-4fb9-b2ce-09ae7048be5f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:39.684128 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cd266e20-9cd1-4fb9-b2ce-09ae7048be5f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:39.685034 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cd266e20-9cd1-4fb9-b2ce-09ae7048be5f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:39.685672 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cd266e20-9cd1-4fb9-b2ce-09ae7048be5f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:39.686556 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cd266e20-9cd1-4fb9-b2ce-09ae7048be5f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:40.000599 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cd266e20-9cd1-4fb9-b2ce-09ae7048be5f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:40.011655 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cd266e20-9cd1-4fb9-b2ce-09ae7048be5f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.340976 Aug 24 11:27:40.012294 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 152/301] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:39 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:40.709975 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-bb72810c-77b3-48bd-92d2-e7f980224c67 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:40.710509 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-bb72810c-77b3-48bd-92d2-e7f980224c67 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:40.716978 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb72810c-77b3-48bd-92d2-e7f980224c67 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:40.717455 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb72810c-77b3-48bd-92d2-e7f980224c67 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:40.717895 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb72810c-77b3-48bd-92d2-e7f980224c67 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:40.718581 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb72810c-77b3-48bd-92d2-e7f980224c67 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:40.719035 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb72810c-77b3-48bd-92d2-e7f980224c67 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:40.719449 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb72810c-77b3-48bd-92d2-e7f980224c67 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:40.744479 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-bb72810c-77b3-48bd-92d2-e7f980224c67 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Going to try to terminate instance {{(pid=121222) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:27:41.034205 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e748ea66-d6fc-4383-834d-bba4ae18d236 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:41.034837 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e748ea66-d6fc-4383-834d-bba4ae18d236 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:41.049399 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e748ea66-d6fc-4383-834d-bba4ae18d236 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:41.050252 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e748ea66-d6fc-4383-834d-bba4ae18d236 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:41.050799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e748ea66-d6fc-4383-834d-bba4ae18d236 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:41.051832 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e748ea66-d6fc-4383-834d-bba4ae18d236 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:41.052351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e748ea66-d6fc-4383-834d-bba4ae18d236 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:41.053246 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e748ea66-d6fc-4383-834d-bba4ae18d236 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:41.123775 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-bb72810c-77b3-48bd-92d2-e7f980224c67 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 204 len: 0 microversion: 2.1 time: 0.417460 Aug 24 11:27:41.125484 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 150/302] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:27:40 2022] DELETE /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:27:41.134259 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7b048266-218f-43da-b205-1e4b05ba9a03 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:41.134966 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7b048266-218f-43da-b205-1e4b05ba9a03 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:41.145581 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b048266-218f-43da-b205-1e4b05ba9a03 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:41.146179 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b048266-218f-43da-b205-1e4b05ba9a03 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:41.146801 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b048266-218f-43da-b205-1e4b05ba9a03 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:41.147669 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b048266-218f-43da-b205-1e4b05ba9a03 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:41.148282 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b048266-218f-43da-b205-1e4b05ba9a03 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:41.148960 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b048266-218f-43da-b205-1e4b05ba9a03 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:41.300687 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e748ea66-d6fc-4383-834d-bba4ae18d236 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:41.309070 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e748ea66-d6fc-4383-834d-bba4ae18d236 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.280386 Aug 24 11:27:41.309901 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 153/303] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:41 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:41.503582 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7b048266-218f-43da-b205-1e4b05ba9a03 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:41.512398 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7b048266-218f-43da-b205-1e4b05ba9a03 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1503 microversion: 2.1 time: 0.382279 Aug 24 11:27:41.513209 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 151/304] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:41 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1503 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:42.332069 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a1867572-ea76-432e-bcac-1b8236c9bb4e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:42.332681 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a1867572-ea76-432e-bcac-1b8236c9bb4e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:42.340436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1867572-ea76-432e-bcac-1b8236c9bb4e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:42.340940 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1867572-ea76-432e-bcac-1b8236c9bb4e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:42.341390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1867572-ea76-432e-bcac-1b8236c9bb4e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:42.342156 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1867572-ea76-432e-bcac-1b8236c9bb4e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:42.342620 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1867572-ea76-432e-bcac-1b8236c9bb4e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:42.343070 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1867572-ea76-432e-bcac-1b8236c9bb4e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:42.364245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:42.538293 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-54899877-e87d-478f-b2a6-012898259e75 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:42.538906 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-54899877-e87d-478f-b2a6-012898259e75 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:42.551928 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-54899877-e87d-478f-b2a6-012898259e75 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:42.555372 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-54899877-e87d-478f-b2a6-012898259e75 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:42.559915 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-54899877-e87d-478f-b2a6-012898259e75 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:42.560858 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-54899877-e87d-478f-b2a6-012898259e75 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:42.561391 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-54899877-e87d-478f-b2a6-012898259e75 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:42.566217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-54899877-e87d-478f-b2a6-012898259e75 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:42.575583 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:42.615801 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a1867572-ea76-432e-bcac-1b8236c9bb4e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:42.624074 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a1867572-ea76-432e-bcac-1b8236c9bb4e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.295993 Aug 24 11:27:42.624654 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 154/305] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:42 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:42.779247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-54899877-e87d-478f-b2a6-012898259e75 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:42.787869 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-54899877-e87d-478f-b2a6-012898259e75 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1503 microversion: 2.1 time: 0.255504 Aug 24 11:27:42.788402 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 152/306] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:42 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1503 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:43.646536 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fc3e8fe5-914d-4574-85d8-7dccccf6caf1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:43.647061 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fc3e8fe5-914d-4574-85d8-7dccccf6caf1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:43.661859 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc3e8fe5-914d-4574-85d8-7dccccf6caf1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:43.662665 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc3e8fe5-914d-4574-85d8-7dccccf6caf1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:43.663261 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc3e8fe5-914d-4574-85d8-7dccccf6caf1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:43.664173 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc3e8fe5-914d-4574-85d8-7dccccf6caf1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:43.664627 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc3e8fe5-914d-4574-85d8-7dccccf6caf1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:43.665047 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc3e8fe5-914d-4574-85d8-7dccccf6caf1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:43.811121 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3e4a3494-8473-4b85-8836-d48736f1e998 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:43.811784 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3e4a3494-8473-4b85-8836-d48736f1e998 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:43.830930 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3e4a3494-8473-4b85-8836-d48736f1e998 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:43.831995 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3e4a3494-8473-4b85-8836-d48736f1e998 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:43.832578 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3e4a3494-8473-4b85-8836-d48736f1e998 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:43.833502 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3e4a3494-8473-4b85-8836-d48736f1e998 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:43.833922 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3e4a3494-8473-4b85-8836-d48736f1e998 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:43.834543 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3e4a3494-8473-4b85-8836-d48736f1e998 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:43.992994 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fc3e8fe5-914d-4574-85d8-7dccccf6caf1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:44.007732 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fc3e8fe5-914d-4574-85d8-7dccccf6caf1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.365803 Aug 24 11:27:44.024899 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 155/307] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:43 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:44.036042 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3e4a3494-8473-4b85-8836-d48736f1e998 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:44.050090 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3e4a3494-8473-4b85-8836-d48736f1e998 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1503 microversion: 2.1 time: 0.245104 Aug 24 11:27:44.063941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 153/308] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:43 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:27:44.827983 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-28fc82ab-159a-42f6-9d59-aab84b23d3a0 req-3e7f6a14-b75f-476e-b840-c5a5b43eb427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e245ee8-79ab-4ab1-a25d-01c3d304358a", "name": "network-vif-deleted", "tag": "59b4abb9-64c6-4cc1-8b75-4d9b880a9c2d"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:44.839522 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-28fc82ab-159a-42f6-9d59-aab84b23d3a0 req-3e7f6a14-b75f-476e-b840-c5a5b43eb427 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:44.840294 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-28fc82ab-159a-42f6-9d59-aab84b23d3a0 req-3e7f6a14-b75f-476e-b840-c5a5b43eb427 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:44.840760 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-28fc82ab-159a-42f6-9d59-aab84b23d3a0 req-3e7f6a14-b75f-476e-b840-c5a5b43eb427 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:44.854847 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-28fc82ab-159a-42f6-9d59-aab84b23d3a0 req-3e7f6a14-b75f-476e-b840-c5a5b43eb427 service nova] Creating event network-vif-deleted:59b4abb9-64c6-4cc1-8b75-4d9b880a9c2d for instance 2e245ee8-79ab-4ab1-a25d-01c3d304358a on hv-cinder-85427 Aug 24 11:27:44.860433 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-28fc82ab-159a-42f6-9d59-aab84b23d3a0 req-3e7f6a14-b75f-476e-b840-c5a5b43eb427 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040640 Aug 24 11:27:44.861031 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 156/309] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:27:45.032968 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8083b2e5-862b-4bd0-80fc-92e6a36cda8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:45.034629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8083b2e5-862b-4bd0-80fc-92e6a36cda8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:45.046610 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8083b2e5-862b-4bd0-80fc-92e6a36cda8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:45.048412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8083b2e5-862b-4bd0-80fc-92e6a36cda8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:45.049925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8083b2e5-862b-4bd0-80fc-92e6a36cda8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:45.051383 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8083b2e5-862b-4bd0-80fc-92e6a36cda8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:45.052071 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8083b2e5-862b-4bd0-80fc-92e6a36cda8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:45.053317 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8083b2e5-862b-4bd0-80fc-92e6a36cda8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:45.077641 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7cd89bf4-8756-4360-9a11-a9b5627d468b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:45.081078 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7cd89bf4-8756-4360-9a11-a9b5627d468b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:45.095754 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7cd89bf4-8756-4360-9a11-a9b5627d468b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:45.097985 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7cd89bf4-8756-4360-9a11-a9b5627d468b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:45.099906 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7cd89bf4-8756-4360-9a11-a9b5627d468b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:45.100819 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7cd89bf4-8756-4360-9a11-a9b5627d468b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:45.103620 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7cd89bf4-8756-4360-9a11-a9b5627d468b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:45.104957 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7cd89bf4-8756-4360-9a11-a9b5627d468b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:45.324482 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7cd89bf4-8756-4360-9a11-a9b5627d468b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:45.340065 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7cd89bf4-8756-4360-9a11-a9b5627d468b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 200 len: 1299 microversion: 2.1 time: 0.266299 Aug 24 11:27:45.341047 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 157/310] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:45 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 1299 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:45.396362 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8083b2e5-862b-4bd0-80fc-92e6a36cda8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:45.407317 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8083b2e5-862b-4bd0-80fc-92e6a36cda8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.379236 Aug 24 11:27:45.408704 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 154/311] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:45 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:46.366914 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-91d8e812-2ea0-4bf6-a976-1b31983992de tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:46.368566 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-91d8e812-2ea0-4bf6-a976-1b31983992de tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 2e245ee8-79ab-4ab1-a25d-01c3d304358a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:46.384922 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91d8e812-2ea0-4bf6-a976-1b31983992de tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:46.394902 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91d8e812-2ea0-4bf6-a976-1b31983992de tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:46.395364 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91d8e812-2ea0-4bf6-a976-1b31983992de tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:46.396122 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91d8e812-2ea0-4bf6-a976-1b31983992de tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:46.398942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91d8e812-2ea0-4bf6-a976-1b31983992de tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:46.400127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91d8e812-2ea0-4bf6-a976-1b31983992de tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:46.420687 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-91d8e812-2ea0-4bf6-a976-1b31983992de tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] HTTP exception thrown: Instance 2e245ee8-79ab-4ab1-a25d-01c3d304358a could not be found. Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-91d8e812-2ea0-4bf6-a976-1b31983992de tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Request method failure captured: Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a HTTP/1.1 Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgsJsca3R_z0iqw-qPbDhLpaPP6AyOsYngbXzUO26hDogMzc60bzA13_ZVds31bvbcZQ5Cwr5jl-RRvUJBUn9DtURehW4csbwKWBI1cKrCIlBd_DseOFnYzZsQxK8T2-6-WHCLcj0uHMrG62FNKGGJQeOHPkXOMdKtFm1ZvpmZXY_3c Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: a1b8e9dbce62475eaa97dbad91fcd910 Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesActionsTest-2116353781 Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:27:46.422679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:27:46.424236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a1b8e9dbce62475eaa97dbad91fcd910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a1b8e9dbce62475eaa97dbad91fcd910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a1b8e9dbce62475eaa97dbad91fcd910", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a1b8e9dbce62475eaa97dbad91fcd910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:27:46.424236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesActionsTest-2116353781 Aug 24 11:27:46.424236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: a1b8e9dbce62475eaa97dbad91fcd910 Aug 24 11:27:46.424236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesActionsTest-2116353781 Aug 24 11:27:46.424236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesActionsTest-2116353781-project Aug 24 11:27:46.424236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:27:46.424236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:27:46.424236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 8a512d59d7b4477b88f7bb9532141d06 Aug 24 11:27:46.424236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesActionsTest-2116353781-project Aug 24 11:27:46.424236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:27:46.424236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 2e245ee8-79ab-4ab1-a25d-01c3d304358a could not be found. Aug 24 11:27:46.424236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '2e245ee8-79ab-4ab1-a25d-01c3d304358a'} Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e245ee8-79ab-4ab1-a25d-01c3d304358a could not be found. Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:27:46.425147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e245ee8-79ab-4ab1-a25d-01c3d304358a could not be found. Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e245ee8-79ab-4ab1-a25d-01c3d304358a could not be found. Aug 24 11:27:46.426693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:27:46.430333 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-91d8e812-2ea0-4bf6-a976-1b31983992de tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Returning 404 to user: Instance 2e245ee8-79ab-4ab1-a25d-01c3d304358a could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:27:46.431649 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3efa4092-2230-432a-a1f2-653324a592ef tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:46.432693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-91d8e812-2ea0-4bf6-a976-1b31983992de tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a" status: 404 len: 111 microversion: 2.1 time: 0.071607 Aug 24 11:27:46.432815 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3efa4092-2230-432a-a1f2-653324a592ef tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:46.434659 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 158/312] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:46 2022] GET /compute/v2.1/servers/2e245ee8-79ab-4ab1-a25d-01c3d304358a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:27:46.447946 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3efa4092-2230-432a-a1f2-653324a592ef tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:46.448293 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3efa4092-2230-432a-a1f2-653324a592ef tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:46.448734 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3efa4092-2230-432a-a1f2-653324a592ef tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:46.449447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3efa4092-2230-432a-a1f2-653324a592ef tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:46.449934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3efa4092-2230-432a-a1f2-653324a592ef tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:46.450364 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3efa4092-2230-432a-a1f2-653324a592ef tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:46.664403 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3efa4092-2230-432a-a1f2-653324a592ef tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:46.673221 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3efa4092-2230-432a-a1f2-653324a592ef tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.245296 Aug 24 11:27:46.675380 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 155/313] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:46 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:46.682495 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1438470316", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "networks": [{"uuid": "7614d6c9-7ae0-4d40-863d-d15c9e8c60f3"}]}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:46.777268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] validate_networks() for [('7614d6c9-7ae0-4d40-863d-d15c9e8c60f3', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:27:46.777862 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-60d1928f-0949-40d6-95a1-c0d380a3cdd6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Action: 'create', calling method: .version_select at 0x7f723dac2d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-125789780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBclj286vB2DHYMkGlvsY8OhhQ9bas8n9NXHbMVl1A56j59mdgOh0QDPf5y1T7BzU32zg6cGPoHsXDXQJdFEFRozDqx/J5DtT/grhntK20qTtQd++4yGxxPSDqslbBW1SA=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:46.794451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-60d1928f-0949-40d6-95a1-c0d380a3cdd6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Getting quotas for project 2ac977e5066e413c9e9cc06b5a012fdf. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:27:46.799962 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-60d1928f-0949-40d6-95a1-c0d380a3cdd6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Getting quotas for user b1971caade1b4c34a6c69c600070bc5e and project 2ac977e5066e413c9e9cc06b5a012fdf. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:27:46.923527 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-60d1928f-0949-40d6-95a1-c0d380a3cdd6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.462591 Aug 24 11:27:46.924142 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 159/314] 10.222.0.83 () {60 vars in 1159 bytes} [Wed Aug 24 11:27:46 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:27:47.210189 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:27:47.210613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:27:47.211092 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:27:47.211652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:27:47.211893 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:27:47.226816 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:47.228964 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:47.228964 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:47.228964 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:47.228964 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:47.229334 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:47.247482 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Getting quotas for project a1b8e9dbce62475eaa97dbad91fcd910. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:27:47.251730 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Getting quotas for user 8a512d59d7b4477b88f7bb9532141d06 and project a1b8e9dbce62475eaa97dbad91fcd910. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:27:47.266845 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:27:47.269716 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:27:47.428393 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6c9b460d-d975-41de-b05a-77261e40803a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.750663 Aug 24 11:27:47.432777 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 156/315] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:27:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:27:47.442012 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f12f761d-d903-49e4-8024-0bf747e34152 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:47.443871 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f12f761d-d903-49e4-8024-0bf747e34152 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:47.531772 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f12f761d-d903-49e4-8024-0bf747e34152 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:47.539249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f12f761d-d903-49e4-8024-0bf747e34152 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1214 microversion: 2.1 time: 0.101775 Aug 24 11:27:47.539910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 160/316] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:47 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:47.697077 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e67548b2-c7b8-48ac-8e9d-3e0438de49c6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:47.697749 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e67548b2-c7b8-48ac-8e9d-3e0438de49c6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:47.704337 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e67548b2-c7b8-48ac-8e9d-3e0438de49c6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:47.704813 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e67548b2-c7b8-48ac-8e9d-3e0438de49c6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:47.705236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e67548b2-c7b8-48ac-8e9d-3e0438de49c6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:47.705969 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e67548b2-c7b8-48ac-8e9d-3e0438de49c6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:47.706409 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e67548b2-c7b8-48ac-8e9d-3e0438de49c6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:47.706822 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e67548b2-c7b8-48ac-8e9d-3e0438de49c6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:47.857041 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e67548b2-c7b8-48ac-8e9d-3e0438de49c6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:47.865486 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e67548b2-c7b8-48ac-8e9d-3e0438de49c6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.172635 Aug 24 11:27:47.866092 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 157/317] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:47 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:48.566092 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3afa8b0c-f383-4d40-a7f0-222133344e8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:48.566699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3afa8b0c-f383-4d40-a7f0-222133344e8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:48.574113 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3afa8b0c-f383-4d40-a7f0-222133344e8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:48.574595 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3afa8b0c-f383-4d40-a7f0-222133344e8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:48.575132 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3afa8b0c-f383-4d40-a7f0-222133344e8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:48.575756 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3afa8b0c-f383-4d40-a7f0-222133344e8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:48.576217 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3afa8b0c-f383-4d40-a7f0-222133344e8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:48.576647 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3afa8b0c-f383-4d40-a7f0-222133344e8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:48.676103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3afa8b0c-f383-4d40-a7f0-222133344e8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:48.691275 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3afa8b0c-f383-4d40-a7f0-222133344e8c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1218 microversion: 2.1 time: 0.126223 Aug 24 11:27:48.691275 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 161/318] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:48 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:48.889229 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ef5dad19-353b-4c8b-a4ce-46d383290d17 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:48.889888 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ef5dad19-353b-4c8b-a4ce-46d383290d17 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:48.895818 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ef5dad19-353b-4c8b-a4ce-46d383290d17 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:48.896299 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ef5dad19-353b-4c8b-a4ce-46d383290d17 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:48.896825 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ef5dad19-353b-4c8b-a4ce-46d383290d17 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:48.897505 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ef5dad19-353b-4c8b-a4ce-46d383290d17 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:48.898012 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ef5dad19-353b-4c8b-a4ce-46d383290d17 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:48.898393 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ef5dad19-353b-4c8b-a4ce-46d383290d17 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:49.054890 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ef5dad19-353b-4c8b-a4ce-46d383290d17 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:49.063612 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ef5dad19-353b-4c8b-a4ce-46d383290d17 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.179001 Aug 24 11:27:49.069791 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 158/319] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:48 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:49.717182 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e1905caa-1ba6-4f6d-9d03-e4c40a10372e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:49.724022 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e1905caa-1ba6-4f6d-9d03-e4c40a10372e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:49.732932 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1905caa-1ba6-4f6d-9d03-e4c40a10372e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:49.732932 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1905caa-1ba6-4f6d-9d03-e4c40a10372e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:49.732932 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1905caa-1ba6-4f6d-9d03-e4c40a10372e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:49.733545 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1905caa-1ba6-4f6d-9d03-e4c40a10372e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:49.734036 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1905caa-1ba6-4f6d-9d03-e4c40a10372e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:49.734532 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1905caa-1ba6-4f6d-9d03-e4c40a10372e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:49.820593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e1905caa-1ba6-4f6d-9d03-e4c40a10372e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:49.832257 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e1905caa-1ba6-4f6d-9d03-e4c40a10372e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1266 microversion: 2.1 time: 0.118690 Aug 24 11:27:49.833926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 162/320] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:49 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:50.091890 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d53cbae7-708f-4a69-a824-ccb3cc4b2757 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:50.093058 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d53cbae7-708f-4a69-a824-ccb3cc4b2757 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:50.101354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d53cbae7-708f-4a69-a824-ccb3cc4b2757 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:50.101843 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d53cbae7-708f-4a69-a824-ccb3cc4b2757 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:50.102304 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d53cbae7-708f-4a69-a824-ccb3cc4b2757 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:50.103829 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d53cbae7-708f-4a69-a824-ccb3cc4b2757 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:50.104288 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d53cbae7-708f-4a69-a824-ccb3cc4b2757 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:50.104708 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d53cbae7-708f-4a69-a824-ccb3cc4b2757 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:50.268735 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d53cbae7-708f-4a69-a824-ccb3cc4b2757 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:50.276869 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d53cbae7-708f-4a69-a824-ccb3cc4b2757 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.195573 Aug 24 11:27:50.277909 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 159/321] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:50 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:50.864212 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2b6bbd87-858f-410d-a999-7f6dd8990c2c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:50.864909 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2b6bbd87-858f-410d-a999-7f6dd8990c2c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:50.872234 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b6bbd87-858f-410d-a999-7f6dd8990c2c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:50.872801 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b6bbd87-858f-410d-a999-7f6dd8990c2c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:50.873309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b6bbd87-858f-410d-a999-7f6dd8990c2c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:50.874123 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b6bbd87-858f-410d-a999-7f6dd8990c2c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:50.874647 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b6bbd87-858f-410d-a999-7f6dd8990c2c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:50.875221 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b6bbd87-858f-410d-a999-7f6dd8990c2c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:50.945422 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2b6bbd87-858f-410d-a999-7f6dd8990c2c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:50.954513 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2b6bbd87-858f-410d-a999-7f6dd8990c2c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1272 microversion: 2.1 time: 0.093974 Aug 24 11:27:50.955356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 163/322] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:50 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:51.300549 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b6c8fd72-1692-42fc-9bcb-199722a2e3df tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:51.300549 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b6c8fd72-1692-42fc-9bcb-199722a2e3df tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:51.306294 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b6c8fd72-1692-42fc-9bcb-199722a2e3df tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:51.307427 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b6c8fd72-1692-42fc-9bcb-199722a2e3df tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:51.308165 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b6c8fd72-1692-42fc-9bcb-199722a2e3df tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:51.308941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b6c8fd72-1692-42fc-9bcb-199722a2e3df tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:51.309461 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b6c8fd72-1692-42fc-9bcb-199722a2e3df tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:51.309978 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b6c8fd72-1692-42fc-9bcb-199722a2e3df tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:51.473301 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b6c8fd72-1692-42fc-9bcb-199722a2e3df tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:51.481920 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b6c8fd72-1692-42fc-9bcb-199722a2e3df tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.187183 Aug 24 11:27:51.482765 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 160/323] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:51 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:51.991508 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e446b57c-59b0-47ab-a2f1-2618585ecf1f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:51.994713 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e446b57c-59b0-47ab-a2f1-2618585ecf1f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:52.005065 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e446b57c-59b0-47ab-a2f1-2618585ecf1f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:52.005541 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e446b57c-59b0-47ab-a2f1-2618585ecf1f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:52.006506 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e446b57c-59b0-47ab-a2f1-2618585ecf1f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:52.006718 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e446b57c-59b0-47ab-a2f1-2618585ecf1f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:52.007172 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e446b57c-59b0-47ab-a2f1-2618585ecf1f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:52.007594 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e446b57c-59b0-47ab-a2f1-2618585ecf1f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:52.117151 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-1a08d491-747d-4cc3-a154-6964550831bf req-e9d4b935-5bc4-4824-a007-7c964e38ffe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6770dbbf-dc3b-45c2-9f29-722621023736", "tag": "d6830d7e-1514-4a2a-9112-d922dbc015d4"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:27:52.128334 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-1a08d491-747d-4cc3-a154-6964550831bf req-e9d4b935-5bc4-4824-a007-7c964e38ffe1 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:52.129259 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-1a08d491-747d-4cc3-a154-6964550831bf req-e9d4b935-5bc4-4824-a007-7c964e38ffe1 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:52.129745 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-1a08d491-747d-4cc3-a154-6964550831bf req-e9d4b935-5bc4-4824-a007-7c964e38ffe1 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:52.142265 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-1a08d491-747d-4cc3-a154-6964550831bf req-e9d4b935-5bc4-4824-a007-7c964e38ffe1 service nova] Creating event network-changed:d6830d7e-1514-4a2a-9112-d922dbc015d4 for instance 6770dbbf-dc3b-45c2-9f29-722621023736 on hv-cinder-85427 Aug 24 11:27:52.148058 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-1a08d491-747d-4cc3-a154-6964550831bf req-e9d4b935-5bc4-4824-a007-7c964e38ffe1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034641 Aug 24 11:27:52.148778 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 161/324] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:27:52.209138 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e446b57c-59b0-47ab-a2f1-2618585ecf1f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:52.218387 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e446b57c-59b0-47ab-a2f1-2618585ecf1f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.239489 Aug 24 11:27:52.219068 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 164/325] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:51 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:52.504744 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-82566a65-96b1-43a1-88e0-1df08609a412 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:52.505433 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-82566a65-96b1-43a1-88e0-1df08609a412 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:52.512482 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-82566a65-96b1-43a1-88e0-1df08609a412 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:52.513014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-82566a65-96b1-43a1-88e0-1df08609a412 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:52.513444 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-82566a65-96b1-43a1-88e0-1df08609a412 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:52.514178 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-82566a65-96b1-43a1-88e0-1df08609a412 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:52.514671 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-82566a65-96b1-43a1-88e0-1df08609a412 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:52.515133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-82566a65-96b1-43a1-88e0-1df08609a412 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:52.672258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-82566a65-96b1-43a1-88e0-1df08609a412 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:52.680996 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-82566a65-96b1-43a1-88e0-1df08609a412 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.180485 Aug 24 11:27:52.682794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 162/326] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:52 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:53.239606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-afa61735-56cf-4d2d-8c68-da28bd8d6893 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:53.240220 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-afa61735-56cf-4d2d-8c68-da28bd8d6893 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:53.247059 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-afa61735-56cf-4d2d-8c68-da28bd8d6893 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:53.247451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-afa61735-56cf-4d2d-8c68-da28bd8d6893 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:53.248060 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-afa61735-56cf-4d2d-8c68-da28bd8d6893 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:53.248768 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-afa61735-56cf-4d2d-8c68-da28bd8d6893 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:53.249222 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-afa61735-56cf-4d2d-8c68-da28bd8d6893 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:53.249646 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-afa61735-56cf-4d2d-8c68-da28bd8d6893 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:53.399040 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-afa61735-56cf-4d2d-8c68-da28bd8d6893 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:53.407368 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-afa61735-56cf-4d2d-8c68-da28bd8d6893 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.171673 Aug 24 11:27:53.408193 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 165/327] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:53 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:53.703632 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6b3c767f-cbea-4dc0-a99d-24f770b3fa36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:53.704270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6b3c767f-cbea-4dc0-a99d-24f770b3fa36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:53.710236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b3c767f-cbea-4dc0-a99d-24f770b3fa36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:53.710718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b3c767f-cbea-4dc0-a99d-24f770b3fa36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:53.711155 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b3c767f-cbea-4dc0-a99d-24f770b3fa36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:53.711838 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b3c767f-cbea-4dc0-a99d-24f770b3fa36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:53.712292 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b3c767f-cbea-4dc0-a99d-24f770b3fa36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:53.713348 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b3c767f-cbea-4dc0-a99d-24f770b3fa36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:53.852209 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6b3c767f-cbea-4dc0-a99d-24f770b3fa36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:53.860535 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6b3c767f-cbea-4dc0-a99d-24f770b3fa36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.160675 Aug 24 11:27:53.861113 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 163/328] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:53 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:54.433039 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8ed521a6-b070-4dc2-bf59-a0a4785e7325 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:54.433653 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8ed521a6-b070-4dc2-bf59-a0a4785e7325 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:54.440147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ed521a6-b070-4dc2-bf59-a0a4785e7325 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:54.440634 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ed521a6-b070-4dc2-bf59-a0a4785e7325 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:54.441076 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ed521a6-b070-4dc2-bf59-a0a4785e7325 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:54.441794 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ed521a6-b070-4dc2-bf59-a0a4785e7325 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:54.442520 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ed521a6-b070-4dc2-bf59-a0a4785e7325 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:54.442937 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ed521a6-b070-4dc2-bf59-a0a4785e7325 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:54.572970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8ed521a6-b070-4dc2-bf59-a0a4785e7325 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:54.581681 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8ed521a6-b070-4dc2-bf59-a0a4785e7325 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.153927 Aug 24 11:27:54.583000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 166/329] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:54 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:54.880610 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-809f1d35-0aca-40f8-9414-76902e69085f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:54.881179 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-809f1d35-0aca-40f8-9414-76902e69085f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:54.887066 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-809f1d35-0aca-40f8-9414-76902e69085f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:54.887560 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-809f1d35-0aca-40f8-9414-76902e69085f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:54.888065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-809f1d35-0aca-40f8-9414-76902e69085f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:54.888681 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-809f1d35-0aca-40f8-9414-76902e69085f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:54.889135 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-809f1d35-0aca-40f8-9414-76902e69085f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:54.889557 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-809f1d35-0aca-40f8-9414-76902e69085f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:55.025620 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-809f1d35-0aca-40f8-9414-76902e69085f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:55.035560 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-809f1d35-0aca-40f8-9414-76902e69085f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.158824 Aug 24 11:27:55.036145 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 164/330] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:54 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:55.603606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a267dab3-9afc-4748-b51a-e2037be7a71e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:55.604166 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a267dab3-9afc-4748-b51a-e2037be7a71e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:55.610714 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a267dab3-9afc-4748-b51a-e2037be7a71e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:55.611236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a267dab3-9afc-4748-b51a-e2037be7a71e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:55.611676 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a267dab3-9afc-4748-b51a-e2037be7a71e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:55.612364 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a267dab3-9afc-4748-b51a-e2037be7a71e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:55.612817 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a267dab3-9afc-4748-b51a-e2037be7a71e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:55.613247 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a267dab3-9afc-4748-b51a-e2037be7a71e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:55.757745 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a267dab3-9afc-4748-b51a-e2037be7a71e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:55.767134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a267dab3-9afc-4748-b51a-e2037be7a71e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.167611 Aug 24 11:27:55.767719 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 167/331] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:55 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:56.057676 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-770f4b59-ed5f-4eaf-8619-4ea111e8bd2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:56.061349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-770f4b59-ed5f-4eaf-8619-4ea111e8bd2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:56.069281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-770f4b59-ed5f-4eaf-8619-4ea111e8bd2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:56.069777 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-770f4b59-ed5f-4eaf-8619-4ea111e8bd2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:56.070249 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-770f4b59-ed5f-4eaf-8619-4ea111e8bd2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:56.070968 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-770f4b59-ed5f-4eaf-8619-4ea111e8bd2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:56.071418 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-770f4b59-ed5f-4eaf-8619-4ea111e8bd2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:56.072042 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-770f4b59-ed5f-4eaf-8619-4ea111e8bd2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:56.216307 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-770f4b59-ed5f-4eaf-8619-4ea111e8bd2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:56.224684 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-770f4b59-ed5f-4eaf-8619-4ea111e8bd2c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.171889 Aug 24 11:27:56.225504 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 165/332] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:56 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:56.790138 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5d7026e1-b2f1-401c-b624-fb3cf57e64ea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:56.790575 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5d7026e1-b2f1-401c-b624-fb3cf57e64ea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:56.796953 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d7026e1-b2f1-401c-b624-fb3cf57e64ea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:56.797437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d7026e1-b2f1-401c-b624-fb3cf57e64ea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:56.797895 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d7026e1-b2f1-401c-b624-fb3cf57e64ea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:56.798592 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d7026e1-b2f1-401c-b624-fb3cf57e64ea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:56.799050 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d7026e1-b2f1-401c-b624-fb3cf57e64ea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:56.799476 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d7026e1-b2f1-401c-b624-fb3cf57e64ea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:56.933839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5d7026e1-b2f1-401c-b624-fb3cf57e64ea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:56.941600 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5d7026e1-b2f1-401c-b624-fb3cf57e64ea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.155577 Aug 24 11:27:56.942196 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 168/333] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:56 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:57.246620 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f8bce50f-258f-4aa1-9dcb-d187a6064b81 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:57.247226 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f8bce50f-258f-4aa1-9dcb-d187a6064b81 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:57.249213 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:57.254007 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f8bce50f-258f-4aa1-9dcb-d187a6064b81 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:57.254495 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f8bce50f-258f-4aa1-9dcb-d187a6064b81 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:57.254932 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f8bce50f-258f-4aa1-9dcb-d187a6064b81 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:57.255626 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f8bce50f-258f-4aa1-9dcb-d187a6064b81 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:57.256075 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f8bce50f-258f-4aa1-9dcb-d187a6064b81 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:57.256497 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f8bce50f-258f-4aa1-9dcb-d187a6064b81 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:57.261011 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=6 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:57.395099 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f8bce50f-258f-4aa1-9dcb-d187a6064b81 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:57.403096 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f8bce50f-258f-4aa1-9dcb-d187a6064b81 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.160953 Aug 24 11:27:57.403870 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 166/334] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:57 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:57.962844 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3c875430-9766-4289-bcd4-5ebed0dd015d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:57.963581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3c875430-9766-4289-bcd4-5ebed0dd015d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:57.965395 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:27:57.970669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c875430-9766-4289-bcd4-5ebed0dd015d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:57.971153 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c875430-9766-4289-bcd4-5ebed0dd015d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:57.971590 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c875430-9766-4289-bcd4-5ebed0dd015d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:57.972279 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c875430-9766-4289-bcd4-5ebed0dd015d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:57.972735 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c875430-9766-4289-bcd4-5ebed0dd015d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:57.973158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c875430-9766-4289-bcd4-5ebed0dd015d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:58.104370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3c875430-9766-4289-bcd4-5ebed0dd015d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:58.112645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3c875430-9766-4289-bcd4-5ebed0dd015d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.153663 Aug 24 11:27:58.113196 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 169/335] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:57 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:58.424420 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ae42fa33-d4d3-4afa-842d-8a60a82c01a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:58.425149 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ae42fa33-d4d3-4afa-842d-8a60a82c01a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:58.432864 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ae42fa33-d4d3-4afa-842d-8a60a82c01a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:58.433348 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ae42fa33-d4d3-4afa-842d-8a60a82c01a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:58.433775 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ae42fa33-d4d3-4afa-842d-8a60a82c01a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:58.434486 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ae42fa33-d4d3-4afa-842d-8a60a82c01a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:58.434928 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ae42fa33-d4d3-4afa-842d-8a60a82c01a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:58.435341 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ae42fa33-d4d3-4afa-842d-8a60a82c01a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:58.576085 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ae42fa33-d4d3-4afa-842d-8a60a82c01a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:58.583857 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ae42fa33-d4d3-4afa-842d-8a60a82c01a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.163229 Aug 24 11:27:58.584349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 167/336] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:58 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:59.133607 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a05b941f-11ac-44a9-a8f2-75fd261426e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:59.134767 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a05b941f-11ac-44a9-a8f2-75fd261426e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:59.141218 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a05b941f-11ac-44a9-a8f2-75fd261426e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:59.141698 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a05b941f-11ac-44a9-a8f2-75fd261426e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:59.142164 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a05b941f-11ac-44a9-a8f2-75fd261426e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:59.142861 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a05b941f-11ac-44a9-a8f2-75fd261426e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:59.143308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a05b941f-11ac-44a9-a8f2-75fd261426e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:59.143730 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a05b941f-11ac-44a9-a8f2-75fd261426e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:59.279746 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a05b941f-11ac-44a9-a8f2-75fd261426e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:59.288243 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a05b941f-11ac-44a9-a8f2-75fd261426e7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.158718 Aug 24 11:27:59.288854 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 170/337] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:59 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:27:59.605346 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ff875693-c58c-4569-b672-40e9ffb086e7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:27:59.606031 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ff875693-c58c-4569-b672-40e9ffb086e7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:27:59.611936 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ff875693-c58c-4569-b672-40e9ffb086e7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:59.612410 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ff875693-c58c-4569-b672-40e9ffb086e7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:59.612841 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ff875693-c58c-4569-b672-40e9ffb086e7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:59.613550 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ff875693-c58c-4569-b672-40e9ffb086e7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:27:59.614039 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ff875693-c58c-4569-b672-40e9ffb086e7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:27:59.614459 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ff875693-c58c-4569-b672-40e9ffb086e7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:27:59.750938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ff875693-c58c-4569-b672-40e9ffb086e7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:27:59.758916 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ff875693-c58c-4569-b672-40e9ffb086e7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.158085 Aug 24 11:27:59.759484 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 168/338] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:27:59 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:00.309189 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e54d4eec-70cb-4f72-ba46-333226b75eea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:00.310049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e54d4eec-70cb-4f72-ba46-333226b75eea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:00.313069 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:00.322907 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e54d4eec-70cb-4f72-ba46-333226b75eea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:00.324444 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e54d4eec-70cb-4f72-ba46-333226b75eea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:00.324444 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e54d4eec-70cb-4f72-ba46-333226b75eea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:00.325272 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e54d4eec-70cb-4f72-ba46-333226b75eea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:00.325924 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e54d4eec-70cb-4f72-ba46-333226b75eea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:00.326361 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e54d4eec-70cb-4f72-ba46-333226b75eea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:00.459980 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e54d4eec-70cb-4f72-ba46-333226b75eea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:00.468242 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e54d4eec-70cb-4f72-ba46-333226b75eea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.163113 Aug 24 11:28:00.468814 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 171/339] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:00 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:00.780464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-288f8dda-7af5-48c5-8a30-4245f7c7c104 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:00.781085 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-288f8dda-7af5-48c5-8a30-4245f7c7c104 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:00.788009 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-288f8dda-7af5-48c5-8a30-4245f7c7c104 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:00.788533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-288f8dda-7af5-48c5-8a30-4245f7c7c104 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:00.788962 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-288f8dda-7af5-48c5-8a30-4245f7c7c104 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:00.789668 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-288f8dda-7af5-48c5-8a30-4245f7c7c104 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:00.790283 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-288f8dda-7af5-48c5-8a30-4245f7c7c104 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:00.790561 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-288f8dda-7af5-48c5-8a30-4245f7c7c104 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:00.930822 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-288f8dda-7af5-48c5-8a30-4245f7c7c104 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:00.939217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-288f8dda-7af5-48c5-8a30-4245f7c7c104 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.162685 Aug 24 11:28:00.939784 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 169/340] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:00 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:01.488305 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2bee804a-439d-47ea-850c-d797dd93d07b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:01.489003 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2bee804a-439d-47ea-850c-d797dd93d07b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:01.496917 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2bee804a-439d-47ea-850c-d797dd93d07b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:01.497418 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2bee804a-439d-47ea-850c-d797dd93d07b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:01.497853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2bee804a-439d-47ea-850c-d797dd93d07b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:01.498575 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2bee804a-439d-47ea-850c-d797dd93d07b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:01.499027 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2bee804a-439d-47ea-850c-d797dd93d07b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:01.499447 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2bee804a-439d-47ea-850c-d797dd93d07b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:01.635670 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2bee804a-439d-47ea-850c-d797dd93d07b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:01.643523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2bee804a-439d-47ea-850c-d797dd93d07b tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.159086 Aug 24 11:28:01.644093 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 172/341] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:01 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:01.961138 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d7992716-6e3b-4c31-a36d-f45af4543a27 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:01.961583 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d7992716-6e3b-4c31-a36d-f45af4543a27 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:01.964081 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:01.970015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d7992716-6e3b-4c31-a36d-f45af4543a27 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:01.970607 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d7992716-6e3b-4c31-a36d-f45af4543a27 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:01.970931 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d7992716-6e3b-4c31-a36d-f45af4543a27 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:01.971624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d7992716-6e3b-4c31-a36d-f45af4543a27 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:01.972068 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d7992716-6e3b-4c31-a36d-f45af4543a27 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:01.972530 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d7992716-6e3b-4c31-a36d-f45af4543a27 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:01.977761 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=100 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:02.115678 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d7992716-6e3b-4c31-a36d-f45af4543a27 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:02.123439 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d7992716-6e3b-4c31-a36d-f45af4543a27 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.166454 Aug 24 11:28:02.124006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 170/342] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:01 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:02.664437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6a971dbd-26d7-4df1-890a-d2f03cc54a1c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:02.665796 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6a971dbd-26d7-4df1-890a-d2f03cc54a1c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:02.672738 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a971dbd-26d7-4df1-890a-d2f03cc54a1c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:02.673216 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a971dbd-26d7-4df1-890a-d2f03cc54a1c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:02.673653 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a971dbd-26d7-4df1-890a-d2f03cc54a1c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:02.674392 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a971dbd-26d7-4df1-890a-d2f03cc54a1c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:02.674849 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a971dbd-26d7-4df1-890a-d2f03cc54a1c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:02.675277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a971dbd-26d7-4df1-890a-d2f03cc54a1c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:02.805544 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6a971dbd-26d7-4df1-890a-d2f03cc54a1c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:02.814207 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6a971dbd-26d7-4df1-890a-d2f03cc54a1c tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.153557 Aug 24 11:28:02.814784 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 173/343] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:02 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:03.144680 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-185d57f0-1499-44bc-9115-f9301900b1a4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:03.145281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-185d57f0-1499-44bc-9115-f9301900b1a4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:03.151214 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-185d57f0-1499-44bc-9115-f9301900b1a4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:03.151694 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-185d57f0-1499-44bc-9115-f9301900b1a4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:03.152120 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-185d57f0-1499-44bc-9115-f9301900b1a4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:03.152797 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-185d57f0-1499-44bc-9115-f9301900b1a4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:03.153238 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-185d57f0-1499-44bc-9115-f9301900b1a4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:03.153648 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-185d57f0-1499-44bc-9115-f9301900b1a4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:03.286766 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-185d57f0-1499-44bc-9115-f9301900b1a4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:03.295380 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-185d57f0-1499-44bc-9115-f9301900b1a4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.154607 Aug 24 11:28:03.295956 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 171/344] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:03 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:03.835914 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b7137b1b-d252-43d4-9a3e-199927f29b64 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:03.836545 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b7137b1b-d252-43d4-9a3e-199927f29b64 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:03.843358 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7137b1b-d252-43d4-9a3e-199927f29b64 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:03.843939 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7137b1b-d252-43d4-9a3e-199927f29b64 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:03.844406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7137b1b-d252-43d4-9a3e-199927f29b64 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:03.845106 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7137b1b-d252-43d4-9a3e-199927f29b64 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:03.845557 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7137b1b-d252-43d4-9a3e-199927f29b64 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:03.846012 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7137b1b-d252-43d4-9a3e-199927f29b64 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:03.863959 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:03.982240 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b7137b1b-d252-43d4-9a3e-199927f29b64 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:03.990006 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b7137b1b-d252-43d4-9a3e-199927f29b64 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.157960 Aug 24 11:28:03.990572 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 174/345] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:03 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:04.315253 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-299c4daf-9a4a-4e8d-adc2-f2630bcc837c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:04.315875 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-299c4daf-9a4a-4e8d-adc2-f2630bcc837c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:04.321930 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-299c4daf-9a4a-4e8d-adc2-f2630bcc837c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:04.322419 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-299c4daf-9a4a-4e8d-adc2-f2630bcc837c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:04.322846 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-299c4daf-9a4a-4e8d-adc2-f2630bcc837c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:04.323542 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-299c4daf-9a4a-4e8d-adc2-f2630bcc837c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:04.323991 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-299c4daf-9a4a-4e8d-adc2-f2630bcc837c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:04.324409 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-299c4daf-9a4a-4e8d-adc2-f2630bcc837c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:04.462858 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-299c4daf-9a4a-4e8d-adc2-f2630bcc837c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:04.471208 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-299c4daf-9a4a-4e8d-adc2-f2630bcc837c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.159843 Aug 24 11:28:04.471781 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 172/346] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:04 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:05.010322 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-044a6277-798b-4435-8609-9db489567fea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:05.010940 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-044a6277-798b-4435-8609-9db489567fea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:05.018212 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-044a6277-798b-4435-8609-9db489567fea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:05.018710 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-044a6277-798b-4435-8609-9db489567fea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:05.019224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-044a6277-798b-4435-8609-9db489567fea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:05.019835 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-044a6277-798b-4435-8609-9db489567fea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:05.020293 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-044a6277-798b-4435-8609-9db489567fea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:05.020720 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-044a6277-798b-4435-8609-9db489567fea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:05.161570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-044a6277-798b-4435-8609-9db489567fea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:05.169937 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-044a6277-798b-4435-8609-9db489567fea tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.163368 Aug 24 11:28:05.170502 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 175/347] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:05 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:05.492530 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5b1e4518-632c-4ef2-8af1-f0a1675d49c8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:05.493644 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5b1e4518-632c-4ef2-8af1-f0a1675d49c8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:05.499666 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b1e4518-632c-4ef2-8af1-f0a1675d49c8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:05.500141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b1e4518-632c-4ef2-8af1-f0a1675d49c8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:05.500568 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b1e4518-632c-4ef2-8af1-f0a1675d49c8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:05.501246 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b1e4518-632c-4ef2-8af1-f0a1675d49c8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:05.501693 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b1e4518-632c-4ef2-8af1-f0a1675d49c8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:05.502134 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b1e4518-632c-4ef2-8af1-f0a1675d49c8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:05.633755 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5b1e4518-632c-4ef2-8af1-f0a1675d49c8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:05.642817 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5b1e4518-632c-4ef2-8af1-f0a1675d49c8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.154050 Aug 24 11:28:05.643399 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 173/348] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:05 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:06.191328 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3ef9e253-65a8-4a60-8fea-55b94bc1ff84 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:06.191991 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3ef9e253-65a8-4a60-8fea-55b94bc1ff84 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:06.200121 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3ef9e253-65a8-4a60-8fea-55b94bc1ff84 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:06.200611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3ef9e253-65a8-4a60-8fea-55b94bc1ff84 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:06.201198 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3ef9e253-65a8-4a60-8fea-55b94bc1ff84 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:06.201721 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3ef9e253-65a8-4a60-8fea-55b94bc1ff84 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:06.202198 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3ef9e253-65a8-4a60-8fea-55b94bc1ff84 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:06.202617 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3ef9e253-65a8-4a60-8fea-55b94bc1ff84 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:06.350382 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3ef9e253-65a8-4a60-8fea-55b94bc1ff84 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:06.358952 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3ef9e253-65a8-4a60-8fea-55b94bc1ff84 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.171649 Aug 24 11:28:06.359606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 176/349] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:06 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:06.663394 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0b701299-ea38-4bbc-831e-7def3ae39d0c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:06.664118 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0b701299-ea38-4bbc-831e-7def3ae39d0c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:06.671075 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0b701299-ea38-4bbc-831e-7def3ae39d0c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:06.671819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0b701299-ea38-4bbc-831e-7def3ae39d0c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:06.672289 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0b701299-ea38-4bbc-831e-7def3ae39d0c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:06.673005 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0b701299-ea38-4bbc-831e-7def3ae39d0c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:06.673467 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0b701299-ea38-4bbc-831e-7def3ae39d0c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:06.673920 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0b701299-ea38-4bbc-831e-7def3ae39d0c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:06.821035 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0b701299-ea38-4bbc-831e-7def3ae39d0c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:06.829843 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0b701299-ea38-4bbc-831e-7def3ae39d0c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.169869 Aug 24 11:28:06.830473 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 174/350] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:06 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:07.381091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c5d8154a-cb0b-4348-b179-33b2246f5385 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:07.381695 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c5d8154a-cb0b-4348-b179-33b2246f5385 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:07.388281 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5d8154a-cb0b-4348-b179-33b2246f5385 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:07.388754 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5d8154a-cb0b-4348-b179-33b2246f5385 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:07.389183 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5d8154a-cb0b-4348-b179-33b2246f5385 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:07.389894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5d8154a-cb0b-4348-b179-33b2246f5385 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:07.390370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5d8154a-cb0b-4348-b179-33b2246f5385 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:07.390758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5d8154a-cb0b-4348-b179-33b2246f5385 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:07.527201 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c5d8154a-cb0b-4348-b179-33b2246f5385 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:07.535531 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c5d8154a-cb0b-4348-b179-33b2246f5385 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.158221 Aug 24 11:28:07.543172 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 177/351] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:07 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:07.851097 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4ba40194-1dc3-442a-9662-6ca568687e0f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:07.851707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4ba40194-1dc3-442a-9662-6ca568687e0f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:07.858299 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4ba40194-1dc3-442a-9662-6ca568687e0f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:07.858782 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4ba40194-1dc3-442a-9662-6ca568687e0f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:07.859219 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4ba40194-1dc3-442a-9662-6ca568687e0f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:07.859906 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4ba40194-1dc3-442a-9662-6ca568687e0f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:07.860386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4ba40194-1dc3-442a-9662-6ca568687e0f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:07.860794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4ba40194-1dc3-442a-9662-6ca568687e0f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:07.986821 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4ba40194-1dc3-442a-9662-6ca568687e0f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:07.995139 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4ba40194-1dc3-442a-9662-6ca568687e0f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.147961 Aug 24 11:28:07.995704 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 175/352] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:07 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:08.556124 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-13bf1b21-f819-4306-b4ce-fd71210d79aa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:08.556736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-13bf1b21-f819-4306-b4ce-fd71210d79aa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:08.563571 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-13bf1b21-f819-4306-b4ce-fd71210d79aa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:08.564059 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-13bf1b21-f819-4306-b4ce-fd71210d79aa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:08.564497 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-13bf1b21-f819-4306-b4ce-fd71210d79aa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:08.565207 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-13bf1b21-f819-4306-b4ce-fd71210d79aa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:08.565663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-13bf1b21-f819-4306-b4ce-fd71210d79aa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:08.566120 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-13bf1b21-f819-4306-b4ce-fd71210d79aa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:08.701015 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-13bf1b21-f819-4306-b4ce-fd71210d79aa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:08.709043 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-13bf1b21-f819-4306-b4ce-fd71210d79aa tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.156756 Aug 24 11:28:08.709620 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 178/353] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:08 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:09.016230 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5e33ba36-b20c-4b4f-b000-69b656530fe8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:09.016787 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5e33ba36-b20c-4b4f-b000-69b656530fe8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:09.022857 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5e33ba36-b20c-4b4f-b000-69b656530fe8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:09.023331 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5e33ba36-b20c-4b4f-b000-69b656530fe8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:09.023759 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5e33ba36-b20c-4b4f-b000-69b656530fe8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:09.024435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5e33ba36-b20c-4b4f-b000-69b656530fe8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:09.024883 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5e33ba36-b20c-4b4f-b000-69b656530fe8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:09.025294 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5e33ba36-b20c-4b4f-b000-69b656530fe8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:09.157825 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5e33ba36-b20c-4b4f-b000-69b656530fe8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:09.165919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5e33ba36-b20c-4b4f-b000-69b656530fe8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.153799 Aug 24 11:28:09.166494 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 176/354] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:09 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:09.734311 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6d5e80e8-7692-4787-8028-01ae251a0e4f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:09.738774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6d5e80e8-7692-4787-8028-01ae251a0e4f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:09.741362 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d5e80e8-7692-4787-8028-01ae251a0e4f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:09.741849 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d5e80e8-7692-4787-8028-01ae251a0e4f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:09.742315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d5e80e8-7692-4787-8028-01ae251a0e4f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:09.743003 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d5e80e8-7692-4787-8028-01ae251a0e4f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:09.743462 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d5e80e8-7692-4787-8028-01ae251a0e4f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:09.743884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d5e80e8-7692-4787-8028-01ae251a0e4f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:09.875156 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6d5e80e8-7692-4787-8028-01ae251a0e4f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:09.883195 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6d5e80e8-7692-4787-8028-01ae251a0e4f tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.152683 Aug 24 11:28:09.883786 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 179/355] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:09 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:10.186126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e77d7c0d-33f0-4e31-8a65-8fa107122afa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:10.186786 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e77d7c0d-33f0-4e31-8a65-8fa107122afa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:10.192859 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e77d7c0d-33f0-4e31-8a65-8fa107122afa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:10.194213 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e77d7c0d-33f0-4e31-8a65-8fa107122afa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:10.194213 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e77d7c0d-33f0-4e31-8a65-8fa107122afa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:10.194485 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e77d7c0d-33f0-4e31-8a65-8fa107122afa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:10.194938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e77d7c0d-33f0-4e31-8a65-8fa107122afa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:10.195372 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e77d7c0d-33f0-4e31-8a65-8fa107122afa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:10.330496 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e77d7c0d-33f0-4e31-8a65-8fa107122afa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:10.338941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e77d7c0d-33f0-4e31-8a65-8fa107122afa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.156741 Aug 24 11:28:10.339510 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 177/356] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:10 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:10.903770 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f43aaf60-6284-4902-b648-d11f847c5349 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:10.904410 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f43aaf60-6284-4902-b648-d11f847c5349 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:10.911154 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f43aaf60-6284-4902-b648-d11f847c5349 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:10.911643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f43aaf60-6284-4902-b648-d11f847c5349 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:10.912081 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f43aaf60-6284-4902-b648-d11f847c5349 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:10.912776 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f43aaf60-6284-4902-b648-d11f847c5349 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:10.913230 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f43aaf60-6284-4902-b648-d11f847c5349 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:10.913656 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f43aaf60-6284-4902-b648-d11f847c5349 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:11.040407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f43aaf60-6284-4902-b648-d11f847c5349 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:11.047957 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f43aaf60-6284-4902-b648-d11f847c5349 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.148046 Aug 24 11:28:11.048526 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 180/357] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:10 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:11.359603 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9976bdea-206a-4951-86e9-318d6b323587 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:11.360289 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9976bdea-206a-4951-86e9-318d6b323587 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:11.366390 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9976bdea-206a-4951-86e9-318d6b323587 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:11.366870 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9976bdea-206a-4951-86e9-318d6b323587 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:11.367301 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9976bdea-206a-4951-86e9-318d6b323587 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:11.368053 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9976bdea-206a-4951-86e9-318d6b323587 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:11.368501 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9976bdea-206a-4951-86e9-318d6b323587 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:11.368919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9976bdea-206a-4951-86e9-318d6b323587 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:11.498193 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9976bdea-206a-4951-86e9-318d6b323587 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:11.505790 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9976bdea-206a-4951-86e9-318d6b323587 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.150218 Aug 24 11:28:11.506435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 178/358] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:11 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:12.068291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-64e9451e-1f22-4576-a4d6-483db2539eb2 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:12.068930 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-64e9451e-1f22-4576-a4d6-483db2539eb2 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:12.075979 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-64e9451e-1f22-4576-a4d6-483db2539eb2 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:12.076461 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-64e9451e-1f22-4576-a4d6-483db2539eb2 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:12.076894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-64e9451e-1f22-4576-a4d6-483db2539eb2 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:12.077579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-64e9451e-1f22-4576-a4d6-483db2539eb2 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:12.078059 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-64e9451e-1f22-4576-a4d6-483db2539eb2 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:12.078480 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-64e9451e-1f22-4576-a4d6-483db2539eb2 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:12.207537 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-64e9451e-1f22-4576-a4d6-483db2539eb2 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:12.215127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-64e9451e-1f22-4576-a4d6-483db2539eb2 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.150738 Aug 24 11:28:12.215689 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 181/359] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:12 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:12.526854 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-87421202-bffb-4062-97a2-6fe9d2040b0e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:12.527487 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-87421202-bffb-4062-97a2-6fe9d2040b0e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:12.533788 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-87421202-bffb-4062-97a2-6fe9d2040b0e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:12.534384 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-87421202-bffb-4062-97a2-6fe9d2040b0e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:12.538115 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-87421202-bffb-4062-97a2-6fe9d2040b0e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:12.538115 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-87421202-bffb-4062-97a2-6fe9d2040b0e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:12.538115 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-87421202-bffb-4062-97a2-6fe9d2040b0e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:12.538115 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-87421202-bffb-4062-97a2-6fe9d2040b0e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:12.668609 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-87421202-bffb-4062-97a2-6fe9d2040b0e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:12.676386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-87421202-bffb-4062-97a2-6fe9d2040b0e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.153534 Aug 24 11:28:12.676953 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 179/360] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:12 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:13.235727 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-79bf3023-39a6-4fdb-a31c-ba6c391fd687 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:13.236331 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-79bf3023-39a6-4fdb-a31c-ba6c391fd687 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:13.242712 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79bf3023-39a6-4fdb-a31c-ba6c391fd687 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:13.243194 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79bf3023-39a6-4fdb-a31c-ba6c391fd687 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:13.243629 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79bf3023-39a6-4fdb-a31c-ba6c391fd687 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:13.244313 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79bf3023-39a6-4fdb-a31c-ba6c391fd687 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:13.244765 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79bf3023-39a6-4fdb-a31c-ba6c391fd687 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:13.245184 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79bf3023-39a6-4fdb-a31c-ba6c391fd687 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:13.372714 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-79bf3023-39a6-4fdb-a31c-ba6c391fd687 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:13.380329 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-79bf3023-39a6-4fdb-a31c-ba6c391fd687 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.148559 Aug 24 11:28:13.380882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 182/361] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:13 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:13.437347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:28:13.437523 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Wed Aug 24 11:28:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:28:13.697227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9bb6d323-5ebf-46a9-b449-9844ff98c5ce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:13.697925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9bb6d323-5ebf-46a9-b449-9844ff98c5ce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:13.703945 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9bb6d323-5ebf-46a9-b449-9844ff98c5ce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:13.704441 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9bb6d323-5ebf-46a9-b449-9844ff98c5ce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:13.704858 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9bb6d323-5ebf-46a9-b449-9844ff98c5ce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:13.705552 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9bb6d323-5ebf-46a9-b449-9844ff98c5ce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:13.706030 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9bb6d323-5ebf-46a9-b449-9844ff98c5ce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:13.706450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9bb6d323-5ebf-46a9-b449-9844ff98c5ce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:13.838728 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9bb6d323-5ebf-46a9-b449-9844ff98c5ce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:13.846364 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9bb6d323-5ebf-46a9-b449-9844ff98c5ce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.153034 Aug 24 11:28:13.846925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 180/362] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:13 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:14.401104 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-264fdd32-4d00-4795-a1b2-024164269b8d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:14.401718 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-264fdd32-4d00-4795-a1b2-024164269b8d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:14.412721 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-264fdd32-4d00-4795-a1b2-024164269b8d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:14.413224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-264fdd32-4d00-4795-a1b2-024164269b8d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:14.413711 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-264fdd32-4d00-4795-a1b2-024164269b8d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:14.414463 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-264fdd32-4d00-4795-a1b2-024164269b8d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:14.414950 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-264fdd32-4d00-4795-a1b2-024164269b8d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:14.415526 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-264fdd32-4d00-4795-a1b2-024164269b8d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:14.550066 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-264fdd32-4d00-4795-a1b2-024164269b8d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:14.559475 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-264fdd32-4d00-4795-a1b2-024164269b8d tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.162132 Aug 24 11:28:14.560055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 183/363] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:14 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:14.866841 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9ed20ea4-2e7b-4d86-9bc4-0821bd2b8151 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:14.867449 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9ed20ea4-2e7b-4d86-9bc4-0821bd2b8151 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:14.873423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ed20ea4-2e7b-4d86-9bc4-0821bd2b8151 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:14.873938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ed20ea4-2e7b-4d86-9bc4-0821bd2b8151 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:14.874365 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ed20ea4-2e7b-4d86-9bc4-0821bd2b8151 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:14.875042 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ed20ea4-2e7b-4d86-9bc4-0821bd2b8151 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:14.875485 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ed20ea4-2e7b-4d86-9bc4-0821bd2b8151 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:14.875898 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ed20ea4-2e7b-4d86-9bc4-0821bd2b8151 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:15.005711 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9ed20ea4-2e7b-4d86-9bc4-0821bd2b8151 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:15.014168 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9ed20ea4-2e7b-4d86-9bc4-0821bd2b8151 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.151218 Aug 24 11:28:15.014739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 181/364] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:14 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:15.580494 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-37df50a2-f35c-48a4-8b9c-219313810c95 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:15.581649 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-37df50a2-f35c-48a4-8b9c-219313810c95 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:15.588095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37df50a2-f35c-48a4-8b9c-219313810c95 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:15.588579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37df50a2-f35c-48a4-8b9c-219313810c95 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:15.589012 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37df50a2-f35c-48a4-8b9c-219313810c95 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:15.589703 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37df50a2-f35c-48a4-8b9c-219313810c95 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:15.590285 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37df50a2-f35c-48a4-8b9c-219313810c95 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:15.590717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37df50a2-f35c-48a4-8b9c-219313810c95 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:15.727839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-37df50a2-f35c-48a4-8b9c-219313810c95 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:15.735896 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-37df50a2-f35c-48a4-8b9c-219313810c95 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.159360 Aug 24 11:28:15.736458 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 184/365] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:15 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:16.034480 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-90db90c0-61ea-44f2-9aec-e330b66f1130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:16.035118 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-90db90c0-61ea-44f2-9aec-e330b66f1130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:16.041644 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-90db90c0-61ea-44f2-9aec-e330b66f1130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:16.042145 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-90db90c0-61ea-44f2-9aec-e330b66f1130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:16.042578 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-90db90c0-61ea-44f2-9aec-e330b66f1130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:16.043308 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-90db90c0-61ea-44f2-9aec-e330b66f1130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:16.043753 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-90db90c0-61ea-44f2-9aec-e330b66f1130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:16.044166 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-90db90c0-61ea-44f2-9aec-e330b66f1130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:16.177820 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-90db90c0-61ea-44f2-9aec-e330b66f1130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:16.185531 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-90db90c0-61ea-44f2-9aec-e330b66f1130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.155165 Aug 24 11:28:16.186138 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 182/366] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:16 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:16.757764 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-40af744a-ed77-45f1-b97f-fe7c67b20467 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:16.759298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-40af744a-ed77-45f1-b97f-fe7c67b20467 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:16.766172 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40af744a-ed77-45f1-b97f-fe7c67b20467 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:16.766655 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40af744a-ed77-45f1-b97f-fe7c67b20467 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:16.767102 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40af744a-ed77-45f1-b97f-fe7c67b20467 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:16.767777 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40af744a-ed77-45f1-b97f-fe7c67b20467 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:16.768230 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40af744a-ed77-45f1-b97f-fe7c67b20467 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:16.768648 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40af744a-ed77-45f1-b97f-fe7c67b20467 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:16.901161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-40af744a-ed77-45f1-b97f-fe7c67b20467 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:16.910970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-40af744a-ed77-45f1-b97f-fe7c67b20467 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.157080 Aug 24 11:28:16.911591 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 185/367] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:16 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:17.207504 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-36183345-7249-410c-9124-336078a658d4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:17.208119 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-36183345-7249-410c-9124-336078a658d4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:17.215039 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36183345-7249-410c-9124-336078a658d4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:17.215520 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36183345-7249-410c-9124-336078a658d4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:17.215953 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36183345-7249-410c-9124-336078a658d4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:17.216635 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36183345-7249-410c-9124-336078a658d4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:17.217081 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36183345-7249-410c-9124-336078a658d4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:17.217493 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36183345-7249-410c-9124-336078a658d4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:17.346986 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-36183345-7249-410c-9124-336078a658d4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:17.355270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-36183345-7249-410c-9124-336078a658d4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.151613 Aug 24 11:28:17.355895 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 183/368] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:17 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:17.932576 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-978a8cad-79ba-43a0-87d8-b294c6012e73 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:17.933139 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-978a8cad-79ba-43a0-87d8-b294c6012e73 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:17.939567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-978a8cad-79ba-43a0-87d8-b294c6012e73 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:17.940051 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-978a8cad-79ba-43a0-87d8-b294c6012e73 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:17.940485 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-978a8cad-79ba-43a0-87d8-b294c6012e73 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:17.941175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-978a8cad-79ba-43a0-87d8-b294c6012e73 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:17.941628 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-978a8cad-79ba-43a0-87d8-b294c6012e73 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:17.942084 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-978a8cad-79ba-43a0-87d8-b294c6012e73 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:18.072699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-978a8cad-79ba-43a0-87d8-b294c6012e73 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:18.080227 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-978a8cad-79ba-43a0-87d8-b294c6012e73 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.152143 Aug 24 11:28:18.080783 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 186/369] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:17 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:18.375253 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-da97d464-0dad-494a-a0b8-1001aabe3e2d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:18.375863 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-da97d464-0dad-494a-a0b8-1001aabe3e2d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:18.382015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-da97d464-0dad-494a-a0b8-1001aabe3e2d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:18.382496 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-da97d464-0dad-494a-a0b8-1001aabe3e2d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:18.382931 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-da97d464-0dad-494a-a0b8-1001aabe3e2d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:18.383621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-da97d464-0dad-494a-a0b8-1001aabe3e2d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:18.387448 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-da97d464-0dad-494a-a0b8-1001aabe3e2d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:18.387448 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-da97d464-0dad-494a-a0b8-1001aabe3e2d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:18.735311 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-da97d464-0dad-494a-a0b8-1001aabe3e2d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:18.743871 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-da97d464-0dad-494a-a0b8-1001aabe3e2d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.372439 Aug 24 11:28:18.744280 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 184/370] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:18 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:19.100768 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d9cdc434-83db-45cc-b084-3de60517454a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:19.101391 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d9cdc434-83db-45cc-b084-3de60517454a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:19.108579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9cdc434-83db-45cc-b084-3de60517454a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:19.109134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9cdc434-83db-45cc-b084-3de60517454a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:19.109532 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9cdc434-83db-45cc-b084-3de60517454a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:19.110252 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9cdc434-83db-45cc-b084-3de60517454a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:19.110711 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9cdc434-83db-45cc-b084-3de60517454a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:19.111134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9cdc434-83db-45cc-b084-3de60517454a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:19.245043 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d9cdc434-83db-45cc-b084-3de60517454a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:19.252806 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d9cdc434-83db-45cc-b084-3de60517454a tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.156009 Aug 24 11:28:19.253375 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 187/371] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:19 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:19.764636 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1d4328f3-45f0-48b2-b2dc-cf3daa45c74f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:19.765250 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1d4328f3-45f0-48b2-b2dc-cf3daa45c74f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:19.771623 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d4328f3-45f0-48b2-b2dc-cf3daa45c74f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:19.772112 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d4328f3-45f0-48b2-b2dc-cf3daa45c74f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:19.772787 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d4328f3-45f0-48b2-b2dc-cf3daa45c74f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:19.774009 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d4328f3-45f0-48b2-b2dc-cf3daa45c74f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:19.774472 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d4328f3-45f0-48b2-b2dc-cf3daa45c74f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:19.774897 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d4328f3-45f0-48b2-b2dc-cf3daa45c74f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:19.912952 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1d4328f3-45f0-48b2-b2dc-cf3daa45c74f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:19.922382 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1d4328f3-45f0-48b2-b2dc-cf3daa45c74f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.161588 Aug 24 11:28:19.930560 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 185/372] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:19 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:20.120465 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-06b92723-5613-459c-bede-3e0ff51b045d req-fec5b30e-8ccd-4cef-8bcc-2429780c372d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6770dbbf-dc3b-45c2-9f29-722621023736", "name": "network-vif-plugged", "status": "completed", "tag": "d6830d7e-1514-4a2a-9112-d922dbc015d4"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:20.130776 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-06b92723-5613-459c-bede-3e0ff51b045d req-fec5b30e-8ccd-4cef-8bcc-2429780c372d service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.131362 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-06b92723-5613-459c-bede-3e0ff51b045d req-fec5b30e-8ccd-4cef-8bcc-2429780c372d service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.131864 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-06b92723-5613-459c-bede-3e0ff51b045d req-fec5b30e-8ccd-4cef-8bcc-2429780c372d service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.143402 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-06b92723-5613-459c-bede-3e0ff51b045d req-fec5b30e-8ccd-4cef-8bcc-2429780c372d service nova] Creating event network-vif-plugged:d6830d7e-1514-4a2a-9112-d922dbc015d4 for instance 6770dbbf-dc3b-45c2-9f29-722621023736 on hv-cinder-85427 Aug 24 11:28:20.149258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-06b92723-5613-459c-bede-3e0ff51b045d req-fec5b30e-8ccd-4cef-8bcc-2429780c372d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033711 Aug 24 11:28:20.150304 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 188/373] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:20.272462 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-501f9bcd-6361-405e-aa9a-dfb01e05359e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:20.273077 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-501f9bcd-6361-405e-aa9a-dfb01e05359e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:20.279561 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-501f9bcd-6361-405e-aa9a-dfb01e05359e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.280048 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-501f9bcd-6361-405e-aa9a-dfb01e05359e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.280492 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-501f9bcd-6361-405e-aa9a-dfb01e05359e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.281184 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-501f9bcd-6361-405e-aa9a-dfb01e05359e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.281915 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-501f9bcd-6361-405e-aa9a-dfb01e05359e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.282341 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-501f9bcd-6361-405e-aa9a-dfb01e05359e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.417455 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-501f9bcd-6361-405e-aa9a-dfb01e05359e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:20.420986 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=100 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:20.425733 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-501f9bcd-6361-405e-aa9a-dfb01e05359e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.157039 Aug 24 11:28:20.426385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 186/374] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:20 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:20.943823 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-aba04053-0d71-49a0-8a43-317a4d852546 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:20.944526 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-aba04053-0d71-49a0-8a43-317a4d852546 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:20.951396 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aba04053-0d71-49a0-8a43-317a4d852546 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.951876 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aba04053-0d71-49a0-8a43-317a4d852546 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.952310 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aba04053-0d71-49a0-8a43-317a4d852546 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:20.952997 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aba04053-0d71-49a0-8a43-317a4d852546 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:20.953448 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aba04053-0d71-49a0-8a43-317a4d852546 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:20.953954 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aba04053-0d71-49a0-8a43-317a4d852546 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:21.083901 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-aba04053-0d71-49a0-8a43-317a4d852546 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:21.091637 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-aba04053-0d71-49a0-8a43-317a4d852546 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.152234 Aug 24 11:28:21.092210 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 189/375] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:20 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:21.446725 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f5e12bcd-3e1e-4e1a-8f6d-b11177b79410 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:21.447341 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f5e12bcd-3e1e-4e1a-8f6d-b11177b79410 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:21.453721 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f5e12bcd-3e1e-4e1a-8f6d-b11177b79410 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:21.454246 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f5e12bcd-3e1e-4e1a-8f6d-b11177b79410 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:21.454697 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f5e12bcd-3e1e-4e1a-8f6d-b11177b79410 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:21.455372 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f5e12bcd-3e1e-4e1a-8f6d-b11177b79410 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:21.455824 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f5e12bcd-3e1e-4e1a-8f6d-b11177b79410 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:21.456248 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f5e12bcd-3e1e-4e1a-8f6d-b11177b79410 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:21.583871 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f5e12bcd-3e1e-4e1a-8f6d-b11177b79410 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:21.591542 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f5e12bcd-3e1e-4e1a-8f6d-b11177b79410 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.148728 Aug 24 11:28:21.592109 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 187/376] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:21 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:22.112459 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1c2b0f9f-7b7c-4ce0-b58d-c6a661c35145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:22.113103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1c2b0f9f-7b7c-4ce0-b58d-c6a661c35145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:22.119517 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c2b0f9f-7b7c-4ce0-b58d-c6a661c35145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:22.120002 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c2b0f9f-7b7c-4ce0-b58d-c6a661c35145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:22.120437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c2b0f9f-7b7c-4ce0-b58d-c6a661c35145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:22.121172 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c2b0f9f-7b7c-4ce0-b58d-c6a661c35145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:22.121700 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c2b0f9f-7b7c-4ce0-b58d-c6a661c35145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:22.122167 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c2b0f9f-7b7c-4ce0-b58d-c6a661c35145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:22.254490 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1c2b0f9f-7b7c-4ce0-b58d-c6a661c35145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:22.263471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1c2b0f9f-7b7c-4ce0-b58d-c6a661c35145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.155075 Aug 24 11:28:22.264060 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 190/377] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:22 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:22.613277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b4660ed1-c877-4135-ad9b-15ac5face4d1 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:22.613277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b4660ed1-c877-4135-ad9b-15ac5face4d1 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:22.619948 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b4660ed1-c877-4135-ad9b-15ac5face4d1 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:22.620457 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b4660ed1-c877-4135-ad9b-15ac5face4d1 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:22.620927 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b4660ed1-c877-4135-ad9b-15ac5face4d1 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:22.621615 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b4660ed1-c877-4135-ad9b-15ac5face4d1 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:22.622094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b4660ed1-c877-4135-ad9b-15ac5face4d1 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:22.622511 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b4660ed1-c877-4135-ad9b-15ac5face4d1 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:22.759016 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b4660ed1-c877-4135-ad9b-15ac5face4d1 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:22.766982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b4660ed1-c877-4135-ad9b-15ac5face4d1 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.158324 Aug 24 11:28:22.767545 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 188/378] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:22 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:23.285384 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f1c0812f-ae96-4354-853b-13d79ebc6f20 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:23.286108 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f1c0812f-ae96-4354-853b-13d79ebc6f20 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:23.293261 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1c0812f-ae96-4354-853b-13d79ebc6f20 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:23.293746 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1c0812f-ae96-4354-853b-13d79ebc6f20 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:23.294217 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1c0812f-ae96-4354-853b-13d79ebc6f20 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:23.294912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1c0812f-ae96-4354-853b-13d79ebc6f20 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:23.295373 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1c0812f-ae96-4354-853b-13d79ebc6f20 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:23.295795 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1c0812f-ae96-4354-853b-13d79ebc6f20 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:23.424645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f1c0812f-ae96-4354-853b-13d79ebc6f20 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:23.428166 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:23.432829 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f1c0812f-ae96-4354-853b-13d79ebc6f20 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1522 microversion: 2.1 time: 0.151612 Aug 24 11:28:23.433398 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 191/379] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:23 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:23.787914 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6317c050-a658-45f3-9d70-d04323c2a425 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:23.788530 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6317c050-a658-45f3-9d70-d04323c2a425 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:23.795085 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6317c050-a658-45f3-9d70-d04323c2a425 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:23.795569 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6317c050-a658-45f3-9d70-d04323c2a425 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:23.796001 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6317c050-a658-45f3-9d70-d04323c2a425 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:23.796684 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6317c050-a658-45f3-9d70-d04323c2a425 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:23.797145 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6317c050-a658-45f3-9d70-d04323c2a425 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:23.797619 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6317c050-a658-45f3-9d70-d04323c2a425 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:23.926564 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6317c050-a658-45f3-9d70-d04323c2a425 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:23.935074 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6317c050-a658-45f3-9d70-d04323c2a425 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.151048 Aug 24 11:28:23.935642 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 189/380] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:23 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:24.453447 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a3aface1-e7e9-4b2d-b76f-35b8f4e7d808 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:24.454061 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a3aface1-e7e9-4b2d-b76f-35b8f4e7d808 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:24.460866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a3aface1-e7e9-4b2d-b76f-35b8f4e7d808 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:24.461348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a3aface1-e7e9-4b2d-b76f-35b8f4e7d808 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:24.461784 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a3aface1-e7e9-4b2d-b76f-35b8f4e7d808 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:24.462502 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a3aface1-e7e9-4b2d-b76f-35b8f4e7d808 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:24.462961 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a3aface1-e7e9-4b2d-b76f-35b8f4e7d808 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:24.472194 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a3aface1-e7e9-4b2d-b76f-35b8f4e7d808 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:24.615120 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a3aface1-e7e9-4b2d-b76f-35b8f4e7d808 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:24.625490 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a3aface1-e7e9-4b2d-b76f-35b8f4e7d808 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1502 microversion: 2.1 time: 0.176058 Aug 24 11:28:24.626110 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 192/381] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:24 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:24.648824 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-271d017b-5f15-48dc-b8df-a69e6a82d0b8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:24.649431 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-271d017b-5f15-48dc-b8df-a69e6a82d0b8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:24.655804 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-271d017b-5f15-48dc-b8df-a69e6a82d0b8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:24.656561 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-271d017b-5f15-48dc-b8df-a69e6a82d0b8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:24.656997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-271d017b-5f15-48dc-b8df-a69e6a82d0b8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:24.657697 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-271d017b-5f15-48dc-b8df-a69e6a82d0b8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:24.658186 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-271d017b-5f15-48dc-b8df-a69e6a82d0b8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:24.658615 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-271d017b-5f15-48dc-b8df-a69e6a82d0b8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:24.797736 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-271d017b-5f15-48dc-b8df-a69e6a82d0b8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:24.808035 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-271d017b-5f15-48dc-b8df-a69e6a82d0b8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1514 microversion: 2.1 time: 0.163235 Aug 24 11:28:24.808796 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 190/382] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:24 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:24.955805 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9461839c-eda5-4e6e-83f4-5caf34e77872 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:24.956414 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9461839c-eda5-4e6e-83f4-5caf34e77872 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:24.962738 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9461839c-eda5-4e6e-83f4-5caf34e77872 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:24.965154 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9461839c-eda5-4e6e-83f4-5caf34e77872 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:24.965154 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9461839c-eda5-4e6e-83f4-5caf34e77872 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:24.965154 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9461839c-eda5-4e6e-83f4-5caf34e77872 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:24.965154 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9461839c-eda5-4e6e-83f4-5caf34e77872 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:24.965628 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9461839c-eda5-4e6e-83f4-5caf34e77872 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:25.100026 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9461839c-eda5-4e6e-83f4-5caf34e77872 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:25.108086 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9461839c-eda5-4e6e-83f4-5caf34e77872 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1314 microversion: 2.1 time: 0.156095 Aug 24 11:28:25.108652 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 193/383] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:24 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:26.128865 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-45d81234-7419-4807-939e-d917b68c8e07 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:26.130071 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-45d81234-7419-4807-939e-d917b68c8e07 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:26.136529 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-45d81234-7419-4807-939e-d917b68c8e07 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:26.136992 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-45d81234-7419-4807-939e-d917b68c8e07 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:26.137425 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-45d81234-7419-4807-939e-d917b68c8e07 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:26.138140 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-45d81234-7419-4807-939e-d917b68c8e07 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:26.138595 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-45d81234-7419-4807-939e-d917b68c8e07 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:26.139031 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-45d81234-7419-4807-939e-d917b68c8e07 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:26.275498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-45d81234-7419-4807-939e-d917b68c8e07 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:26.284649 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-45d81234-7419-4807-939e-d917b68c8e07 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1498 microversion: 2.1 time: 0.159715 Aug 24 11:28:26.285225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 191/384] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:26 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:27.543962 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ef593605-eacd-4c50-ae33-c302a87b13c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:27.546197 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ef593605-eacd-4c50-ae33-c302a87b13c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:27.552600 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef593605-eacd-4c50-ae33-c302a87b13c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:27.553074 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef593605-eacd-4c50-ae33-c302a87b13c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:27.553503 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef593605-eacd-4c50-ae33-c302a87b13c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:27.554206 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef593605-eacd-4c50-ae33-c302a87b13c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:27.555276 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef593605-eacd-4c50-ae33-c302a87b13c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:27.555693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef593605-eacd-4c50-ae33-c302a87b13c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:27.577934 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-ef593605-eacd-4c50-ae33-c302a87b13c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lazy-loading 'flavor' on Instance uuid ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:28:27.748855 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f1d77747-33fc-45b0-8e8f-13a98230ae01 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:27.749416 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f1d77747-33fc-45b0-8e8f-13a98230ae01 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:27.756433 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1d77747-33fc-45b0-8e8f-13a98230ae01 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:27.758080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1d77747-33fc-45b0-8e8f-13a98230ae01 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:27.758080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1d77747-33fc-45b0-8e8f-13a98230ae01 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:27.758289 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1d77747-33fc-45b0-8e8f-13a98230ae01 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:27.758730 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1d77747-33fc-45b0-8e8f-13a98230ae01 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:27.759155 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1d77747-33fc-45b0-8e8f-13a98230ae01 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:27.792595 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f1d77747-33fc-45b0-8e8f-13a98230ae01 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Going to try to terminate instance {{(pid=121222) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:28:27.918705 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ef593605-eacd-4c50-ae33-c302a87b13c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "POST /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939/action" status: 200 len: 32 microversion: 2.1 time: 0.378700 Aug 24 11:28:27.919606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 194/385] 10.222.0.83 () {60 vars in 1278 bytes} [Wed Aug 24 11:28:27 2022] POST /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939/action => generated 32 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 11:28:27.930405 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6f5478c8-de06-493a-9265-5ca092965e4f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:27.931249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6f5478c8-de06-493a-9265-5ca092965e4f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:27.937444 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f5478c8-de06-493a-9265-5ca092965e4f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:27.941824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f5478c8-de06-493a-9265-5ca092965e4f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:27.941824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f5478c8-de06-493a-9265-5ca092965e4f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:27.941824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f5478c8-de06-493a-9265-5ca092965e4f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:27.941824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f5478c8-de06-493a-9265-5ca092965e4f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:27.942300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6f5478c8-de06-493a-9265-5ca092965e4f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:28.075294 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6f5478c8-de06-493a-9265-5ca092965e4f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:28.079846 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f1d77747-33fc-45b0-8e8f-13a98230ae01 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 204 len: 0 microversion: 2.1 time: 0.334925 Aug 24 11:28:28.080439 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 192/386] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:28:27 2022] DELETE /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:28:28.083185 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6f5478c8-de06-493a-9265-5ca092965e4f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.157444 Aug 24 11:28:28.087404 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 195/387] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:27 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:28.094976 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-fd882a57-6f64-42f6-88c6-a01ddaf36aac tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:28.095710 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-fd882a57-6f64-42f6-88c6-a01ddaf36aac tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:28.102130 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fd882a57-6f64-42f6-88c6-a01ddaf36aac tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:28.102615 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fd882a57-6f64-42f6-88c6-a01ddaf36aac tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:28.103045 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fd882a57-6f64-42f6-88c6-a01ddaf36aac tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:28.103735 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fd882a57-6f64-42f6-88c6-a01ddaf36aac tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:28.104184 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fd882a57-6f64-42f6-88c6-a01ddaf36aac tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:28.104599 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fd882a57-6f64-42f6-88c6-a01ddaf36aac tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:28.234958 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-fd882a57-6f64-42f6-88c6-a01ddaf36aac tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:28.242731 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-fd882a57-6f64-42f6-88c6-a01ddaf36aac tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1504 microversion: 2.1 time: 0.152082 Aug 24 11:28:28.243627 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 193/388] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:28 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:29.106567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-65cb4a54-0b3b-4c4b-bf97-36d0fb10ea40 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:29.107174 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-65cb4a54-0b3b-4c4b-bf97-36d0fb10ea40 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:29.113689 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-65cb4a54-0b3b-4c4b-bf97-36d0fb10ea40 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:29.114198 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-65cb4a54-0b3b-4c4b-bf97-36d0fb10ea40 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:29.114639 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-65cb4a54-0b3b-4c4b-bf97-36d0fb10ea40 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:29.115326 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-65cb4a54-0b3b-4c4b-bf97-36d0fb10ea40 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:29.115782 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-65cb4a54-0b3b-4c4b-bf97-36d0fb10ea40 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:29.116222 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-65cb4a54-0b3b-4c4b-bf97-36d0fb10ea40 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:29.246765 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-65cb4a54-0b3b-4c4b-bf97-36d0fb10ea40 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:29.254440 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-65cb4a54-0b3b-4c4b-bf97-36d0fb10ea40 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.151716 Aug 24 11:28:29.255006 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 196/389] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:29 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:29.263388 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-cf14258d-1c04-4777-bfb5-2ca3ec5dbe36 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:29.263999 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-cf14258d-1c04-4777-bfb5-2ca3ec5dbe36 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:29.270127 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cf14258d-1c04-4777-bfb5-2ca3ec5dbe36 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:29.270611 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cf14258d-1c04-4777-bfb5-2ca3ec5dbe36 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:29.271046 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cf14258d-1c04-4777-bfb5-2ca3ec5dbe36 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:29.271732 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cf14258d-1c04-4777-bfb5-2ca3ec5dbe36 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:29.272187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cf14258d-1c04-4777-bfb5-2ca3ec5dbe36 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:29.272609 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cf14258d-1c04-4777-bfb5-2ca3ec5dbe36 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:29.405402 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-cf14258d-1c04-4777-bfb5-2ca3ec5dbe36 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:29.414128 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-cf14258d-1c04-4777-bfb5-2ca3ec5dbe36 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1504 microversion: 2.1 time: 0.153947 Aug 24 11:28:29.414728 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 194/390] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:29 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:30.275862 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ea1bfaf1-50dc-4cbb-8174-13bdba3d45c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:30.276469 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ea1bfaf1-50dc-4cbb-8174-13bdba3d45c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:30.283237 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea1bfaf1-50dc-4cbb-8174-13bdba3d45c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:30.283715 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea1bfaf1-50dc-4cbb-8174-13bdba3d45c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:30.284152 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea1bfaf1-50dc-4cbb-8174-13bdba3d45c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:30.284845 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea1bfaf1-50dc-4cbb-8174-13bdba3d45c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:30.285296 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea1bfaf1-50dc-4cbb-8174-13bdba3d45c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:30.285714 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea1bfaf1-50dc-4cbb-8174-13bdba3d45c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:30.415190 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ea1bfaf1-50dc-4cbb-8174-13bdba3d45c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:30.422984 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ea1bfaf1-50dc-4cbb-8174-13bdba3d45c4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.151076 Aug 24 11:28:30.423560 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 197/391] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:30 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:30.435232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2c10a7b3-1e7b-420d-95e7-9683d3fbe657 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:30.435833 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-2c10a7b3-1e7b-420d-95e7-9683d3fbe657 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:30.442044 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2c10a7b3-1e7b-420d-95e7-9683d3fbe657 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:30.442535 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2c10a7b3-1e7b-420d-95e7-9683d3fbe657 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:30.443006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2c10a7b3-1e7b-420d-95e7-9683d3fbe657 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:30.443732 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2c10a7b3-1e7b-420d-95e7-9683d3fbe657 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:30.444184 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2c10a7b3-1e7b-420d-95e7-9683d3fbe657 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:30.444639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2c10a7b3-1e7b-420d-95e7-9683d3fbe657 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:30.576568 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-2c10a7b3-1e7b-420d-95e7-9683d3fbe657 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:30.584145 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-2c10a7b3-1e7b-420d-95e7-9683d3fbe657 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1504 microversion: 2.1 time: 0.152749 Aug 24 11:28:30.584700 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 195/392] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:30 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:31.444247 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-be4c36a0-bd50-4247-aa3f-5579b446a190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:31.445422 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-be4c36a0-bd50-4247-aa3f-5579b446a190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:31.447870 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=54 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:31.452529 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-be4c36a0-bd50-4247-aa3f-5579b446a190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:31.453016 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-be4c36a0-bd50-4247-aa3f-5579b446a190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:31.453449 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-be4c36a0-bd50-4247-aa3f-5579b446a190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:31.454164 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-be4c36a0-bd50-4247-aa3f-5579b446a190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:31.454620 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-be4c36a0-bd50-4247-aa3f-5579b446a190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:31.455039 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-be4c36a0-bd50-4247-aa3f-5579b446a190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:31.591897 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-be4c36a0-bd50-4247-aa3f-5579b446a190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:31.600016 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-be4c36a0-bd50-4247-aa3f-5579b446a190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.159406 Aug 24 11:28:31.600867 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 198/393] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:31 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:31.604513 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e43cbd9e-1e34-429e-922b-065701f1f547 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:31.605120 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e43cbd9e-1e34-429e-922b-065701f1f547 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:31.611448 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e43cbd9e-1e34-429e-922b-065701f1f547 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:31.612308 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e43cbd9e-1e34-429e-922b-065701f1f547 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:31.612818 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e43cbd9e-1e34-429e-922b-065701f1f547 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:31.613594 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e43cbd9e-1e34-429e-922b-065701f1f547 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:31.614173 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e43cbd9e-1e34-429e-922b-065701f1f547 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:31.614671 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e43cbd9e-1e34-429e-922b-065701f1f547 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:31.742737 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e43cbd9e-1e34-429e-922b-065701f1f547 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:31.750399 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e43cbd9e-1e34-429e-922b-065701f1f547 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1504 microversion: 2.1 time: 0.149796 Aug 24 11:28:31.750956 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 196/394] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:31 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:32.621496 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5b261fd0-c124-42f7-bc07-316c1ada26b5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:32.622436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5b261fd0-c124-42f7-bc07-316c1ada26b5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:32.629031 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b261fd0-c124-42f7-bc07-316c1ada26b5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:32.629514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b261fd0-c124-42f7-bc07-316c1ada26b5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:32.630005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b261fd0-c124-42f7-bc07-316c1ada26b5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:32.630732 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b261fd0-c124-42f7-bc07-316c1ada26b5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:32.631190 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b261fd0-c124-42f7-bc07-316c1ada26b5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:32.631611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b261fd0-c124-42f7-bc07-316c1ada26b5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:32.762777 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5b261fd0-c124-42f7-bc07-316c1ada26b5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:32.771090 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5b261fd0-c124-42f7-bc07-316c1ada26b5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.154383 Aug 24 11:28:32.771668 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 199/395] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:32 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:32.772188 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-20b652fb-bd2c-4059-af26-56893d0aa7b9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:32.773407 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-20b652fb-bd2c-4059-af26-56893d0aa7b9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:32.775409 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:32.780025 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-20b652fb-bd2c-4059-af26-56893d0aa7b9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:32.780503 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-20b652fb-bd2c-4059-af26-56893d0aa7b9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:32.781189 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-20b652fb-bd2c-4059-af26-56893d0aa7b9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:32.781907 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-20b652fb-bd2c-4059-af26-56893d0aa7b9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:32.782333 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-20b652fb-bd2c-4059-af26-56893d0aa7b9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:32.782746 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-20b652fb-bd2c-4059-af26-56893d0aa7b9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:32.917951 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-20b652fb-bd2c-4059-af26-56893d0aa7b9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:32.926043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-20b652fb-bd2c-4059-af26-56893d0aa7b9 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1504 microversion: 2.1 time: 0.157573 Aug 24 11:28:32.926614 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 197/396] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:32 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:33.792646 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d11fb424-1c25-464b-ab3c-9fe8aa72eff9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:33.793254 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d11fb424-1c25-464b-ab3c-9fe8aa72eff9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:33.799609 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d11fb424-1c25-464b-ab3c-9fe8aa72eff9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:33.800096 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d11fb424-1c25-464b-ab3c-9fe8aa72eff9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:33.800530 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d11fb424-1c25-464b-ab3c-9fe8aa72eff9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:33.801212 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d11fb424-1c25-464b-ab3c-9fe8aa72eff9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:33.801660 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d11fb424-1c25-464b-ab3c-9fe8aa72eff9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:33.802110 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d11fb424-1c25-464b-ab3c-9fe8aa72eff9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:33.927710 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d11fb424-1c25-464b-ab3c-9fe8aa72eff9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:33.935972 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d11fb424-1c25-464b-ab3c-9fe8aa72eff9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.147338 Aug 24 11:28:33.936536 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 200/397] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:33 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:33.948083 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1d4aaa79-a8f5-4ba8-999f-1e1da26147d7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:33.948689 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1d4aaa79-a8f5-4ba8-999f-1e1da26147d7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:33.954695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d4aaa79-a8f5-4ba8-999f-1e1da26147d7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:33.955177 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d4aaa79-a8f5-4ba8-999f-1e1da26147d7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:33.955609 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d4aaa79-a8f5-4ba8-999f-1e1da26147d7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:33.956288 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d4aaa79-a8f5-4ba8-999f-1e1da26147d7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:33.956735 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d4aaa79-a8f5-4ba8-999f-1e1da26147d7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:33.957153 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d4aaa79-a8f5-4ba8-999f-1e1da26147d7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:34.086455 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1d4aaa79-a8f5-4ba8-999f-1e1da26147d7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:34.094114 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1d4aaa79-a8f5-4ba8-999f-1e1da26147d7 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1504 microversion: 2.1 time: 0.150649 Aug 24 11:28:34.094686 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 198/398] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:33 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:34.957823 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0d8b9675-2790-48b0-abd3-ebc19c3b143c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:34.958726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0d8b9675-2790-48b0-abd3-ebc19c3b143c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:34.968282 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d8b9675-2790-48b0-abd3-ebc19c3b143c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:34.969001 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d8b9675-2790-48b0-abd3-ebc19c3b143c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:34.969658 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d8b9675-2790-48b0-abd3-ebc19c3b143c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:34.970839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d8b9675-2790-48b0-abd3-ebc19c3b143c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:34.971541 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d8b9675-2790-48b0-abd3-ebc19c3b143c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:34.972186 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d8b9675-2790-48b0-abd3-ebc19c3b143c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:35.105558 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0d8b9675-2790-48b0-abd3-ebc19c3b143c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:35.113545 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0d8b9675-2790-48b0-abd3-ebc19c3b143c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.160620 Aug 24 11:28:35.114319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 201/399] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:34 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:35.115022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8086c13f-f9e6-4a0c-98fe-240645626724 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:35.115844 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8086c13f-f9e6-4a0c-98fe-240645626724 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:35.122475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8086c13f-f9e6-4a0c-98fe-240645626724 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:35.123081 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8086c13f-f9e6-4a0c-98fe-240645626724 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:35.123430 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8086c13f-f9e6-4a0c-98fe-240645626724 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:35.124106 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8086c13f-f9e6-4a0c-98fe-240645626724 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:35.124560 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8086c13f-f9e6-4a0c-98fe-240645626724 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:35.124978 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8086c13f-f9e6-4a0c-98fe-240645626724 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:35.390583 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8086c13f-f9e6-4a0c-98fe-240645626724 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:35.398678 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8086c13f-f9e6-4a0c-98fe-240645626724 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1504 microversion: 2.1 time: 0.287397 Aug 24 11:28:35.399240 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 199/400] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:35 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:36.136355 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-87e528be-8520-44b9-b555-77085f3cf2d7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:36.137111 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-87e528be-8520-44b9-b555-77085f3cf2d7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:36.143620 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87e528be-8520-44b9-b555-77085f3cf2d7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:36.144096 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87e528be-8520-44b9-b555-77085f3cf2d7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:36.144528 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87e528be-8520-44b9-b555-77085f3cf2d7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:36.145406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87e528be-8520-44b9-b555-77085f3cf2d7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:36.146071 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87e528be-8520-44b9-b555-77085f3cf2d7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:36.146654 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87e528be-8520-44b9-b555-77085f3cf2d7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:36.362672 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-87e528be-8520-44b9-b555-77085f3cf2d7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:36.371244 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-87e528be-8520-44b9-b555-77085f3cf2d7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.240222 Aug 24 11:28:36.371764 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 202/401] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:36 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:36.419409 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3472cb20-135b-4404-84a9-5fc1d13d76d3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:36.420027 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3472cb20-135b-4404-84a9-5fc1d13d76d3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:36.426289 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3472cb20-135b-4404-84a9-5fc1d13d76d3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:36.426778 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3472cb20-135b-4404-84a9-5fc1d13d76d3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:36.427216 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3472cb20-135b-4404-84a9-5fc1d13d76d3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:36.427919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3472cb20-135b-4404-84a9-5fc1d13d76d3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:36.428369 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3472cb20-135b-4404-84a9-5fc1d13d76d3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:36.429418 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3472cb20-135b-4404-84a9-5fc1d13d76d3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:36.562047 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3472cb20-135b-4404-84a9-5fc1d13d76d3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:36.571033 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3472cb20-135b-4404-84a9-5fc1d13d76d3 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1504 microversion: 2.1 time: 0.155316 Aug 24 11:28:36.571609 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 200/402] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:36 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:37.392200 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fd5bef63-3f7b-4b47-8788-1ffcb7c482ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:37.392739 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fd5bef63-3f7b-4b47-8788-1ffcb7c482ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:37.399166 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd5bef63-3f7b-4b47-8788-1ffcb7c482ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:37.399647 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd5bef63-3f7b-4b47-8788-1ffcb7c482ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:37.400078 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd5bef63-3f7b-4b47-8788-1ffcb7c482ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:37.400757 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd5bef63-3f7b-4b47-8788-1ffcb7c482ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:37.401206 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd5bef63-3f7b-4b47-8788-1ffcb7c482ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:37.401623 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd5bef63-3f7b-4b47-8788-1ffcb7c482ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:37.531934 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fd5bef63-3f7b-4b47-8788-1ffcb7c482ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:37.540358 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fd5bef63-3f7b-4b47-8788-1ffcb7c482ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.152101 Aug 24 11:28:37.542366 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 203/403] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:37 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:37.591875 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ce5ffda3-f891-4c65-931f-ffe06da9b114 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:37.592475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ce5ffda3-f891-4c65-931f-ffe06da9b114 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:37.598629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce5ffda3-f891-4c65-931f-ffe06da9b114 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:37.599115 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce5ffda3-f891-4c65-931f-ffe06da9b114 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:37.599555 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce5ffda3-f891-4c65-931f-ffe06da9b114 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:37.600243 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce5ffda3-f891-4c65-931f-ffe06da9b114 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:37.601380 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce5ffda3-f891-4c65-931f-ffe06da9b114 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:37.601803 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce5ffda3-f891-4c65-931f-ffe06da9b114 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:37.736301 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ce5ffda3-f891-4c65-931f-ffe06da9b114 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:37.739929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:37.744511 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ce5ffda3-f891-4c65-931f-ffe06da9b114 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1504 microversion: 2.1 time: 0.156452 Aug 24 11:28:37.745124 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 201/404] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:37 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:38.561470 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-090a77c4-95be-4989-a7e8-823302ddfa76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:38.562133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-090a77c4-95be-4989-a7e8-823302ddfa76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:38.568589 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-090a77c4-95be-4989-a7e8-823302ddfa76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:38.569071 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-090a77c4-95be-4989-a7e8-823302ddfa76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:38.569501 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-090a77c4-95be-4989-a7e8-823302ddfa76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:38.570722 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-090a77c4-95be-4989-a7e8-823302ddfa76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:38.571163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-090a77c4-95be-4989-a7e8-823302ddfa76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:38.571577 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-090a77c4-95be-4989-a7e8-823302ddfa76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:38.707253 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-090a77c4-95be-4989-a7e8-823302ddfa76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:38.715789 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-090a77c4-95be-4989-a7e8-823302ddfa76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.158178 Aug 24 11:28:38.716360 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 204/405] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:38 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:38.765051 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-464516fc-edd7-4390-9051-57dceee6a4c8 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:38.765660 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-464516fc-edd7-4390-9051-57dceee6a4c8 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:38.772428 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-464516fc-edd7-4390-9051-57dceee6a4c8 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:38.777212 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-464516fc-edd7-4390-9051-57dceee6a4c8 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:38.777212 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-464516fc-edd7-4390-9051-57dceee6a4c8 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:38.777212 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-464516fc-edd7-4390-9051-57dceee6a4c8 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:38.777212 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-464516fc-edd7-4390-9051-57dceee6a4c8 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:38.777556 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-464516fc-edd7-4390-9051-57dceee6a4c8 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:38.919507 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-464516fc-edd7-4390-9051-57dceee6a4c8 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:38.927261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-464516fc-edd7-4390-9051-57dceee6a4c8 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1504 microversion: 2.1 time: 0.165964 Aug 24 11:28:38.927830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 202/406] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:38 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:39.724114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-5f5c41a8-c640-4536-a435-cd41474746e9 req-04a25520-67b8-473a-96b7-b41d8404a7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6770dbbf-dc3b-45c2-9f29-722621023736", "name": "network-vif-deleted", "tag": "d6830d7e-1514-4a2a-9112-d922dbc015d4"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:39.735028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5f5c41a8-c640-4536-a435-cd41474746e9 req-04a25520-67b8-473a-96b7-b41d8404a7f7 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:39.735513 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5f5c41a8-c640-4536-a435-cd41474746e9 req-04a25520-67b8-473a-96b7-b41d8404a7f7 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:39.735976 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5f5c41a8-c640-4536-a435-cd41474746e9 req-04a25520-67b8-473a-96b7-b41d8404a7f7 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:39.736240 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-72ed070c-2135-40c4-b1d1-aae8d32f27c1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:39.736852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-72ed070c-2135-40c4-b1d1-aae8d32f27c1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:39.743862 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-72ed070c-2135-40c4-b1d1-aae8d32f27c1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:39.744413 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-72ed070c-2135-40c4-b1d1-aae8d32f27c1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:39.744850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-72ed070c-2135-40c4-b1d1-aae8d32f27c1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:39.745551 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-72ed070c-2135-40c4-b1d1-aae8d32f27c1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:39.746035 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-72ed070c-2135-40c4-b1d1-aae8d32f27c1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:39.746471 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-72ed070c-2135-40c4-b1d1-aae8d32f27c1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:39.747580 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-5f5c41a8-c640-4536-a435-cd41474746e9 req-04a25520-67b8-473a-96b7-b41d8404a7f7 service nova] Creating event network-vif-deleted:d6830d7e-1514-4a2a-9112-d922dbc015d4 for instance 6770dbbf-dc3b-45c2-9f29-722621023736 on hv-cinder-85427 Aug 24 11:28:39.752751 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-5f5c41a8-c640-4536-a435-cd41474746e9 req-04a25520-67b8-473a-96b7-b41d8404a7f7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032335 Aug 24 11:28:39.753549 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 205/407] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:28:39.880728 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-72ed070c-2135-40c4-b1d1-aae8d32f27c1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:39.888832 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-72ed070c-2135-40c4-b1d1-aae8d32f27c1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.156470 Aug 24 11:28:39.889394 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 203/408] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:39 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:39.949165 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-33757a7b-7bf2-46e7-bd10-4b3d6cee7ff0 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:39.950007 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-33757a7b-7bf2-46e7-bd10-4b3d6cee7ff0 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:39.956365 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33757a7b-7bf2-46e7-bd10-4b3d6cee7ff0 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:39.956847 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33757a7b-7bf2-46e7-bd10-4b3d6cee7ff0 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:39.957277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33757a7b-7bf2-46e7-bd10-4b3d6cee7ff0 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:39.958057 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33757a7b-7bf2-46e7-bd10-4b3d6cee7ff0 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:39.958523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33757a7b-7bf2-46e7-bd10-4b3d6cee7ff0 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:39.958914 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33757a7b-7bf2-46e7-bd10-4b3d6cee7ff0 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:40.032934 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-33757a7b-7bf2-46e7-bd10-4b3d6cee7ff0 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:40.041068 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-33757a7b-7bf2-46e7-bd10-4b3d6cee7ff0 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1299 microversion: 2.1 time: 0.096059 Aug 24 11:28:40.041660 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 206/409] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:39 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:40.911326 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-87abae85-dc5d-43d0-aa84-18127ce2fa47 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:40.911934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-87abae85-dc5d-43d0-aa84-18127ce2fa47 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:40.918584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-87abae85-dc5d-43d0-aa84-18127ce2fa47 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:40.919068 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-87abae85-dc5d-43d0-aa84-18127ce2fa47 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:40.919504 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-87abae85-dc5d-43d0-aa84-18127ce2fa47 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:40.920194 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-87abae85-dc5d-43d0-aa84-18127ce2fa47 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:40.920647 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-87abae85-dc5d-43d0-aa84-18127ce2fa47 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:40.921078 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-87abae85-dc5d-43d0-aa84-18127ce2fa47 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:41.061680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-075f47bd-3948-44be-8e79-d140b9434149 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:41.062327 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-075f47bd-3948-44be-8e79-d140b9434149 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:41.066567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-87abae85-dc5d-43d0-aa84-18127ce2fa47 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:41.075721 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-87abae85-dc5d-43d0-aa84-18127ce2fa47 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.168446 Aug 24 11:28:41.076444 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-075f47bd-3948-44be-8e79-d140b9434149 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:41.077193 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-075f47bd-3948-44be-8e79-d140b9434149 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:41.077658 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-075f47bd-3948-44be-8e79-d140b9434149 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:41.078711 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-075f47bd-3948-44be-8e79-d140b9434149 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:41.084376 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-075f47bd-3948-44be-8e79-d140b9434149 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:41.084376 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-075f47bd-3948-44be-8e79-d140b9434149 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:41.084376 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:28:41.087503 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 204/410] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:40 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:41.112152 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-075f47bd-3948-44be-8e79-d140b9434149 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:41.112636 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-075f47bd-3948-44be-8e79-d140b9434149 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:41.113075 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-075f47bd-3948-44be-8e79-d140b9434149 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:41.113517 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-075f47bd-3948-44be-8e79-d140b9434149 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lazy-loading 'fault' on Instance uuid 6770dbbf-dc3b-45c2-9f29-722621023736 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:28:41.158409 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-075f47bd-3948-44be-8e79-d140b9434149 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a512d59d7b4477b88f7bb9532141d06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8e9dbce62475eaa97dbad91fcd910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:41.170228 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-075f47bd-3948-44be-8e79-d140b9434149 tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 200 len: 1304 microversion: 2.1 time: 0.108752 Aug 24 11:28:41.170228 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 207/411] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:41 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:42.096462 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9b4e6e1a-bafe-4e10-8999-02f2e48011f9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:42.097078 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9b4e6e1a-bafe-4e10-8999-02f2e48011f9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:42.103839 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b4e6e1a-bafe-4e10-8999-02f2e48011f9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:42.104333 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b4e6e1a-bafe-4e10-8999-02f2e48011f9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:42.104959 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b4e6e1a-bafe-4e10-8999-02f2e48011f9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:42.105680 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b4e6e1a-bafe-4e10-8999-02f2e48011f9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:42.106354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b4e6e1a-bafe-4e10-8999-02f2e48011f9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:42.106796 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9b4e6e1a-bafe-4e10-8999-02f2e48011f9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:42.189436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ead6e4d4-5c86-4654-ac81-d05a68f20b4e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:42.190108 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ead6e4d4-5c86-4654-ac81-d05a68f20b4e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] [instance: 6770dbbf-dc3b-45c2-9f29-722621023736] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:42.197835 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ead6e4d4-5c86-4654-ac81-d05a68f20b4e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:42.198433 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ead6e4d4-5c86-4654-ac81-d05a68f20b4e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:42.198878 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ead6e4d4-5c86-4654-ac81-d05a68f20b4e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:42.199626 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ead6e4d4-5c86-4654-ac81-d05a68f20b4e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:42.200086 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ead6e4d4-5c86-4654-ac81-d05a68f20b4e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:42.200511 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ead6e4d4-5c86-4654-ac81-d05a68f20b4e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:42.214430 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-ead6e4d4-5c86-4654-ac81-d05a68f20b4e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] HTTP exception thrown: Instance 6770dbbf-dc3b-45c2-9f29-722621023736 could not be found. Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ead6e4d4-5c86-4654-ac81-d05a68f20b4e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Request method failure captured: Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 HTTP/1.1 Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgsJsca3R_z0iqw-qPbDhLpaPP6AyOsYngbXzUO26hDogMzc60bzA13_ZVds31bvbcZQ5Cwr5jl-RRvUJBUn9DtURehW4csbwKWBI1cKrCIlBd_DseOFnYzZsQxK8T2-6-WHCLcj0uHMrG62FNKGGJQeOHPkXOMdKtFm1ZvpmZXY_3c Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: a1b8e9dbce62475eaa97dbad91fcd910 Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesActionsTest-2116353781 Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:28:42.216114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:28:42.217603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a1b8e9dbce62475eaa97dbad91fcd910"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a1b8e9dbce62475eaa97dbad91fcd910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a1b8e9dbce62475eaa97dbad91fcd910", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a1b8e9dbce62475eaa97dbad91fcd910"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:28:42.217603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesActionsTest-2116353781 Aug 24 11:28:42.217603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: a1b8e9dbce62475eaa97dbad91fcd910 Aug 24 11:28:42.217603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesActionsTest-2116353781 Aug 24 11:28:42.217603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesActionsTest-2116353781-project Aug 24 11:28:42.217603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:28:42.217603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:28:42.217603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 8a512d59d7b4477b88f7bb9532141d06 Aug 24 11:28:42.217603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesActionsTest-2116353781-project Aug 24 11:28:42.217603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:28:42.217603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 6770dbbf-dc3b-45c2-9f29-722621023736 could not be found. Aug 24 11:28:42.217603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '6770dbbf-dc3b-45c2-9f29-722621023736'} Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6770dbbf-dc3b-45c2-9f29-722621023736 could not be found. Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:28:42.218525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6770dbbf-dc3b-45c2-9f29-722621023736 could not be found. Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6770dbbf-dc3b-45c2-9f29-722621023736 could not be found. Aug 24 11:28:42.219992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:28:42.221142 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ead6e4d4-5c86-4654-ac81-d05a68f20b4e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] Returning 404 to user: Instance 6770dbbf-dc3b-45c2-9f29-722621023736 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:28:42.221142 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ead6e4d4-5c86-4654-ac81-d05a68f20b4e tempest-VolumesActionsTest-2116353781 tempest-VolumesActionsTest-2116353781-project] 10.222.0.83 "GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736" status: 404 len: 111 microversion: 2.1 time: 0.032030 Aug 24 11:28:42.221142 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 208/412] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:42 2022] GET /compute/v2.1/servers/6770dbbf-dc3b-45c2-9f29-722621023736 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:28:42.245039 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9b4e6e1a-bafe-4e10-8999-02f2e48011f9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:42.253084 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9b4e6e1a-bafe-4e10-8999-02f2e48011f9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.160424 Aug 24 11:28:42.258060 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 205/413] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:42 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:43.273741 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-52fd47dc-6d0d-417c-92fa-4415782f49a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:43.274389 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-52fd47dc-6d0d-417c-92fa-4415782f49a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:43.281808 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-52fd47dc-6d0d-417c-92fa-4415782f49a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:43.282337 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-52fd47dc-6d0d-417c-92fa-4415782f49a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:43.282774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-52fd47dc-6d0d-417c-92fa-4415782f49a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:43.283466 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-52fd47dc-6d0d-417c-92fa-4415782f49a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:43.283920 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-52fd47dc-6d0d-417c-92fa-4415782f49a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:43.284338 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-52fd47dc-6d0d-417c-92fa-4415782f49a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:43.423144 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-52fd47dc-6d0d-417c-92fa-4415782f49a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:43.431754 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-52fd47dc-6d0d-417c-92fa-4415782f49a2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.161920 Aug 24 11:28:43.432328 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 209/414] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:43 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:44.453948 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ac67b5a4-b179-4d48-b3fd-0d7fe303efa9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:44.454566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ac67b5a4-b179-4d48-b3fd-0d7fe303efa9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:44.461532 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ac67b5a4-b179-4d48-b3fd-0d7fe303efa9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:44.462051 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ac67b5a4-b179-4d48-b3fd-0d7fe303efa9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:44.462483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ac67b5a4-b179-4d48-b3fd-0d7fe303efa9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:44.463183 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ac67b5a4-b179-4d48-b3fd-0d7fe303efa9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:44.463638 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ac67b5a4-b179-4d48-b3fd-0d7fe303efa9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:44.464057 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ac67b5a4-b179-4d48-b3fd-0d7fe303efa9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:44.601796 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ac67b5a4-b179-4d48-b3fd-0d7fe303efa9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:44.609919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ac67b5a4-b179-4d48-b3fd-0d7fe303efa9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.159864 Aug 24 11:28:44.610510 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 206/415] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:44 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:45.630614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3088ba5e-5d2a-4dd9-8e9e-c53e7f34dc29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:45.631321 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3088ba5e-5d2a-4dd9-8e9e-c53e7f34dc29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:45.637977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3088ba5e-5d2a-4dd9-8e9e-c53e7f34dc29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:45.638461 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3088ba5e-5d2a-4dd9-8e9e-c53e7f34dc29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:45.638890 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3088ba5e-5d2a-4dd9-8e9e-c53e7f34dc29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:45.639572 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3088ba5e-5d2a-4dd9-8e9e-c53e7f34dc29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:45.640021 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3088ba5e-5d2a-4dd9-8e9e-c53e7f34dc29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:45.640438 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3088ba5e-5d2a-4dd9-8e9e-c53e7f34dc29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:45.776789 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3088ba5e-5d2a-4dd9-8e9e-c53e7f34dc29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:45.785596 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3088ba5e-5d2a-4dd9-8e9e-c53e7f34dc29 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.158767 Aug 24 11:28:45.786221 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 210/416] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:45 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:46.806987 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-205b4ea7-2ea0-46ad-a98a-5b954a891cca tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:46.807691 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-205b4ea7-2ea0-46ad-a98a-5b954a891cca tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:46.813950 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-205b4ea7-2ea0-46ad-a98a-5b954a891cca tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:46.814430 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-205b4ea7-2ea0-46ad-a98a-5b954a891cca tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:46.814861 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-205b4ea7-2ea0-46ad-a98a-5b954a891cca tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:46.815587 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-205b4ea7-2ea0-46ad-a98a-5b954a891cca tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:46.816034 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-205b4ea7-2ea0-46ad-a98a-5b954a891cca tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:46.816445 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-205b4ea7-2ea0-46ad-a98a-5b954a891cca tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:46.944484 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-205b4ea7-2ea0-46ad-a98a-5b954a891cca tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:46.956423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-205b4ea7-2ea0-46ad-a98a-5b954a891cca tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.153177 Aug 24 11:28:46.956989 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 207/417] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:46 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:47.978683 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f224f45b-f5b6-4bbd-b5ed-2f2df5bdee6c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:47.979418 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f224f45b-f5b6-4bbd-b5ed-2f2df5bdee6c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:47.985747 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f224f45b-f5b6-4bbd-b5ed-2f2df5bdee6c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:47.986256 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f224f45b-f5b6-4bbd-b5ed-2f2df5bdee6c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:47.986689 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f224f45b-f5b6-4bbd-b5ed-2f2df5bdee6c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:47.987365 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f224f45b-f5b6-4bbd-b5ed-2f2df5bdee6c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:47.987812 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f224f45b-f5b6-4bbd-b5ed-2f2df5bdee6c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:47.988229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f224f45b-f5b6-4bbd-b5ed-2f2df5bdee6c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:48.117809 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f224f45b-f5b6-4bbd-b5ed-2f2df5bdee6c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:48.125747 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f224f45b-f5b6-4bbd-b5ed-2f2df5bdee6c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.151456 Aug 24 11:28:48.126378 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 211/418] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:47 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:49.146984 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-25dd8faf-d37d-448e-ba71-e29abb1b4a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:49.148156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-25dd8faf-d37d-448e-ba71-e29abb1b4a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:49.154438 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-25dd8faf-d37d-448e-ba71-e29abb1b4a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:49.155190 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-25dd8faf-d37d-448e-ba71-e29abb1b4a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:49.155625 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-25dd8faf-d37d-448e-ba71-e29abb1b4a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:49.156319 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-25dd8faf-d37d-448e-ba71-e29abb1b4a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:49.156772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-25dd8faf-d37d-448e-ba71-e29abb1b4a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:49.157199 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-25dd8faf-d37d-448e-ba71-e29abb1b4a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:49.287940 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-25dd8faf-d37d-448e-ba71-e29abb1b4a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:49.296822 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-25dd8faf-d37d-448e-ba71-e29abb1b4a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.153764 Aug 24 11:28:49.297718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 208/419] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:49 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:50.318476 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-553d7d98-9415-4c99-8d31-b3724079aa8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:50.319499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-553d7d98-9415-4c99-8d31-b3724079aa8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:50.327198 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-553d7d98-9415-4c99-8d31-b3724079aa8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:50.327777 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-553d7d98-9415-4c99-8d31-b3724079aa8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:50.328307 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-553d7d98-9415-4c99-8d31-b3724079aa8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:50.329091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-553d7d98-9415-4c99-8d31-b3724079aa8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:50.329635 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-553d7d98-9415-4c99-8d31-b3724079aa8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:50.330182 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-553d7d98-9415-4c99-8d31-b3724079aa8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:50.462267 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-553d7d98-9415-4c99-8d31-b3724079aa8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:50.469932 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-553d7d98-9415-4c99-8d31-b3724079aa8b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.155374 Aug 24 11:28:50.470489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 212/420] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:50 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:51.491041 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d17391e3-ef31-43b7-8806-cb321c7e61b0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:51.492354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d17391e3-ef31-43b7-8806-cb321c7e61b0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:51.499398 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d17391e3-ef31-43b7-8806-cb321c7e61b0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:51.499805 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d17391e3-ef31-43b7-8806-cb321c7e61b0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:51.500277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d17391e3-ef31-43b7-8806-cb321c7e61b0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:51.500938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d17391e3-ef31-43b7-8806-cb321c7e61b0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:51.501392 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d17391e3-ef31-43b7-8806-cb321c7e61b0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:51.501817 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d17391e3-ef31-43b7-8806-cb321c7e61b0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:51.658248 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d17391e3-ef31-43b7-8806-cb321c7e61b0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:51.667609 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d17391e3-ef31-43b7-8806-cb321c7e61b0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.180648 Aug 24 11:28:51.669926 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 209/421] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:51 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:52.743986 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3365c14b-3e0a-4a19-8909-494cf3dc5797 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:52.744493 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-297996555", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-125789780", "security_groups": [{"name": "tempest-secgroup-smoke-1346915356"}], "networks": [{"uuid": "2e06a300-1294-43f4-a04c-ebfb6991c357"}], "block_device_mapping_v2": [{"uuid": "ba71dec7-77e9-4b67-861d-aa74d1a34844", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:52.744902 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3365c14b-3e0a-4a19-8909-494cf3dc5797 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:52.744902 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3365c14b-3e0a-4a19-8909-494cf3dc5797 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:52.744902 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3365c14b-3e0a-4a19-8909-494cf3dc5797 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:52.744902 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3365c14b-3e0a-4a19-8909-494cf3dc5797 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:52.745256 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3365c14b-3e0a-4a19-8909-494cf3dc5797 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:52.745256 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3365c14b-3e0a-4a19-8909-494cf3dc5797 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:52.745256 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3365c14b-3e0a-4a19-8909-494cf3dc5797 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:52.908128 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] validate_networks() for [('2e06a300-1294-43f4-a04c-ebfb6991c357', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:28:52.959024 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3365c14b-3e0a-4a19-8909-494cf3dc5797 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:52.970987 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3365c14b-3e0a-4a19-8909-494cf3dc5797 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.274694 Aug 24 11:28:52.986663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 213/422] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:52 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:53.525992 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:28:53.527066 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:28:53.530509 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:28:53.531739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:28:53.533606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:28:53.548136 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:53.548953 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:53.549765 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:53.550768 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:53.551452 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:53.552106 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:53.572437 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Getting quotas for project 2ac977e5066e413c9e9cc06b5a012fdf. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:28:53.576877 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Getting quotas for user b1971caade1b4c34a6c69c600070bc5e and project 2ac977e5066e413c9e9cc06b5a012fdf. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:28:53.640069 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:28:53.645739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba71dec7-77e9-4b67-861d-aa74d1a34844',volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:28:54.005709 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c968f6cc-dcce-4416-9cd7-91ce7564fe55 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:54.008074 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c968f6cc-dcce-4416-9cd7-91ce7564fe55 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:54.023868 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c968f6cc-dcce-4416-9cd7-91ce7564fe55 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:54.024809 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c968f6cc-dcce-4416-9cd7-91ce7564fe55 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:54.025256 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c968f6cc-dcce-4416-9cd7-91ce7564fe55 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:54.025997 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c968f6cc-dcce-4416-9cd7-91ce7564fe55 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:54.026643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c968f6cc-dcce-4416-9cd7-91ce7564fe55 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:54.027293 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c968f6cc-dcce-4416-9cd7-91ce7564fe55 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:54.058885 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f00ef36e-0cd1-47fd-87c5-1a1c11ab7af8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.363285 Aug 24 11:28:54.059824 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 210/423] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:28:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:28:54.070845 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-75c48b0c-adfc-49d3-bb44-2b2ae10cf4e5 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:54.071494 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-75c48b0c-adfc-49d3-bb44-2b2ae10cf4e5 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:54.208882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c968f6cc-dcce-4416-9cd7-91ce7564fe55 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:54.218232 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c968f6cc-dcce-4416-9cd7-91ce7564fe55 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.224826 Aug 24 11:28:54.219551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 214/424] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:53 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:54.234193 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-75c48b0c-adfc-49d3-bb44-2b2ae10cf4e5 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:54.242782 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-75c48b0c-adfc-49d3-bb44-2b2ae10cf4e5 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1087 microversion: 2.1 time: 0.176020 Aug 24 11:28:54.243369 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 211/425] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:54 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1087 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:55.239498 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-32eeab97-4914-4fa0-b283-48931da45f76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:55.240068 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-32eeab97-4914-4fa0-b283-48931da45f76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:55.247100 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32eeab97-4914-4fa0-b283-48931da45f76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:55.247578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32eeab97-4914-4fa0-b283-48931da45f76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:55.248009 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32eeab97-4914-4fa0-b283-48931da45f76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:55.248689 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32eeab97-4914-4fa0-b283-48931da45f76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:55.249138 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32eeab97-4914-4fa0-b283-48931da45f76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:55.249629 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32eeab97-4914-4fa0-b283-48931da45f76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:55.263276 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c3f71a26-2319-4e46-b436-95021e27310a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:55.263887 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c3f71a26-2319-4e46-b436-95021e27310a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:55.270642 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c3f71a26-2319-4e46-b436-95021e27310a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:55.271438 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c3f71a26-2319-4e46-b436-95021e27310a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:55.272043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c3f71a26-2319-4e46-b436-95021e27310a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:55.272757 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c3f71a26-2319-4e46-b436-95021e27310a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:55.273214 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c3f71a26-2319-4e46-b436-95021e27310a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:55.273637 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c3f71a26-2319-4e46-b436-95021e27310a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:55.342718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c3f71a26-2319-4e46-b436-95021e27310a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:55.352780 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c3f71a26-2319-4e46-b436-95021e27310a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1137 microversion: 2.1 time: 0.093377 Aug 24 11:28:55.353598 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 212/426] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:55 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1137 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:55.417811 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-32eeab97-4914-4fa0-b283-48931da45f76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:55.428248 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-32eeab97-4914-4fa0-b283-48931da45f76 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.192683 Aug 24 11:28:55.442319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 215/427] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:55 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:56.372611 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0d74206a-5be7-4037-b604-be1b149e1134 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:56.373213 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0d74206a-5be7-4037-b604-be1b149e1134 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:56.380626 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0d74206a-5be7-4037-b604-be1b149e1134 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.381454 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0d74206a-5be7-4037-b604-be1b149e1134 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.382245 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0d74206a-5be7-4037-b604-be1b149e1134 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.383185 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0d74206a-5be7-4037-b604-be1b149e1134 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.383843 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0d74206a-5be7-4037-b604-be1b149e1134 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.384601 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0d74206a-5be7-4037-b604-be1b149e1134 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.452056 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-501fc499-3f10-423d-ac6b-1ddad374ea9a tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:56.454843 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-501fc499-3f10-423d-ac6b-1ddad374ea9a tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:56.457965 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0d74206a-5be7-4037-b604-be1b149e1134 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:56.467022 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-501fc499-3f10-423d-ac6b-1ddad374ea9a tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.467908 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-501fc499-3f10-423d-ac6b-1ddad374ea9a tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.468689 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-501fc499-3f10-423d-ac6b-1ddad374ea9a tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.472712 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-501fc499-3f10-423d-ac6b-1ddad374ea9a tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.475090 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0d74206a-5be7-4037-b604-be1b149e1134 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1185 microversion: 2.1 time: 0.106272 Aug 24 11:28:56.475732 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 213/428] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:56 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:56.476446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-501fc499-3f10-423d-ac6b-1ddad374ea9a tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.477036 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-501fc499-3f10-423d-ac6b-1ddad374ea9a tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.625162 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-501fc499-3f10-423d-ac6b-1ddad374ea9a tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:56.634471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-501fc499-3f10-423d-ac6b-1ddad374ea9a tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1500 microversion: 2.1 time: 0.187947 Aug 24 11:28:56.646649 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 216/429] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:56 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1500 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:56.659172 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2e996b0b-fa01-4332-89e6-2157f205eb99 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8410a5e-fe3f-4f05-8cc0-28921b3c054b"}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:56.662051 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-2e996b0b-fa01-4332-89e6-2157f205eb99 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:56.669725 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2e996b0b-fa01-4332-89e6-2157f205eb99 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.670452 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2e996b0b-fa01-4332-89e6-2157f205eb99 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.671132 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2e996b0b-fa01-4332-89e6-2157f205eb99 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.672205 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2e996b0b-fa01-4332-89e6-2157f205eb99 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.673385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2e996b0b-fa01-4332-89e6-2157f205eb99 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.674115 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2e996b0b-fa01-4332-89e6-2157f205eb99 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.701236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-2e996b0b-fa01-4332-89e6-2157f205eb99 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] HTTP exception thrown: Cannot 'attach_volume' instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 while it is in vm_state rescued Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2e996b0b-fa01-4332-89e6-2157f205eb99 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Request method failure captured: Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: POST /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939/os-volume_attachments HTTP/1.1 Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 74 Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgsA8Jn_BUXkOSSf-IXqjq3ClFLYqNACLutdEq5Ij1NsviZ-h751UGnirP3f1ukDzGHkrgVXnxtFPib47w8CdDod3TnqCh2kVL57Xs2-fzXXISHIUuF_FZW58616j9CbFCbND1btJXqiSIS_4nJdx7k-0ePa33Pu5vyClvgN35VuW6o Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: e2a13f3ca60643a9a3507476325d351a Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:28:56.703150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:28:56.704852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e2a13f3ca60643a9a3507476325d351a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:28:56.704852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:28:56.704852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: e2a13f3ca60643a9a3507476325d351a Aug 24 11:28:56.704852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:28:56.704852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-ServerRescueNegativeTestJSON-1136194767-project Aug 24 11:28:56.704852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:28:56.704852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:28:56.704852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 57be68e76fc14d2ca309571e284509bd Aug 24 11:28:56.704852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1136194767-project Aug 24 11:28:56.704852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Aug 24 11:28:56.704852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {"volumeAttachment": {"volumeId": "d8410a5e-fe3f-4f05-8cc0-28921b3c054b"}} Aug 24 11:28:56.704852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Cannot 'attach_volume' instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 while it is in vm_state rescued Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'server_id': 'ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939', 'body': {'volumeAttachment': {'volumeId': 'd8410a5e-fe3f-4f05-8cc0-28921b3c054b'}}} Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:28:56.705674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 while it is in vm_state rescued Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:28:56.706923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:28:56.708270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:28:56.708270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:28:56.708270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 while it is in vm_state rescued Aug 24 11:28:56.708270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:28:56.710963 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2e996b0b-fa01-4332-89e6-2157f205eb99 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Returning 409 to user: Cannot 'attach_volume' instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 while it is in vm_state rescued {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:28:56.712184 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-2e996b0b-fa01-4332-89e6-2157f205eb99 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "POST /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057650 Aug 24 11:28:56.713038 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 214/430] 10.222.0.83 () {60 vars in 1323 bytes} [Wed Aug 24 11:28:56 2022] POST /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 11:28:56.723738 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f19b5cff-729f-4651-b60e-08ab59569abc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:28:56.724696 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f19b5cff-729f-4651-b60e-08ab59569abc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:56.738356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f19b5cff-729f-4651-b60e-08ab59569abc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.738356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f19b5cff-729f-4651-b60e-08ab59569abc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.738356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f19b5cff-729f-4651-b60e-08ab59569abc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.738356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f19b5cff-729f-4651-b60e-08ab59569abc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.738722 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f19b5cff-729f-4651-b60e-08ab59569abc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.738722 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f19b5cff-729f-4651-b60e-08ab59569abc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.956375 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f19b5cff-729f-4651-b60e-08ab59569abc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "POST /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939/action" status: 202 len: 0 microversion: 2.1 time: 0.237952 Aug 24 11:28:56.956970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 217/431] 10.222.0.83 () {60 vars in 1278 bytes} [Wed Aug 24 11:28:56 2022] POST /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:28:56.965632 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d2477205-44a2-4c36-82c4-875cd09cfa01 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:56.966276 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d2477205-44a2-4c36-82c4-875cd09cfa01 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:56.973321 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d2477205-44a2-4c36-82c4-875cd09cfa01 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.974115 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d2477205-44a2-4c36-82c4-875cd09cfa01 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.974741 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d2477205-44a2-4c36-82c4-875cd09cfa01 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:56.976224 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d2477205-44a2-4c36-82c4-875cd09cfa01 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:56.976966 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d2477205-44a2-4c36-82c4-875cd09cfa01 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:56.977653 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d2477205-44a2-4c36-82c4-875cd09cfa01 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:57.170704 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d2477205-44a2-4c36-82c4-875cd09cfa01 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:57.182206 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d2477205-44a2-4c36-82c4-875cd09cfa01 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1508 microversion: 2.1 time: 0.220255 Aug 24 11:28:57.187043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 215/432] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:56 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:57.501048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-10f88c6b-297c-4968-9730-8fe71e1fa314 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:57.504223 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-10f88c6b-297c-4968-9730-8fe71e1fa314 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:57.522251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-10f88c6b-297c-4968-9730-8fe71e1fa314 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:57.525171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-10f88c6b-297c-4968-9730-8fe71e1fa314 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:57.526036 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-10f88c6b-297c-4968-9730-8fe71e1fa314 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:57.530162 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-10f88c6b-297c-4968-9730-8fe71e1fa314 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:57.534281 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-10f88c6b-297c-4968-9730-8fe71e1fa314 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:57.534954 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-10f88c6b-297c-4968-9730-8fe71e1fa314 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:57.653356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-10f88c6b-297c-4968-9730-8fe71e1fa314 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:57.667756 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-10f88c6b-297c-4968-9730-8fe71e1fa314 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1203 microversion: 2.1 time: 0.172879 Aug 24 11:28:57.668739 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 218/433] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:57 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:58.203584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3bb23071-8f82-4392-99d4-027f5e9b7e73 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:58.204197 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3bb23071-8f82-4392-99d4-027f5e9b7e73 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:58.211162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3bb23071-8f82-4392-99d4-027f5e9b7e73 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:58.211849 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3bb23071-8f82-4392-99d4-027f5e9b7e73 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:58.212285 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3bb23071-8f82-4392-99d4-027f5e9b7e73 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:58.212973 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3bb23071-8f82-4392-99d4-027f5e9b7e73 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:58.213412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3bb23071-8f82-4392-99d4-027f5e9b7e73 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:58.213855 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3bb23071-8f82-4392-99d4-027f5e9b7e73 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:58.422284 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3bb23071-8f82-4392-99d4-027f5e9b7e73 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:58.427618 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3bb23071-8f82-4392-99d4-027f5e9b7e73 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1508 microversion: 2.1 time: 0.227681 Aug 24 11:28:58.428723 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 216/434] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:58 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:28:58.692437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b866baba-3260-4516-b519-4562a2451316 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:58.693112 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b866baba-3260-4516-b519-4562a2451316 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:58.699774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b866baba-3260-4516-b519-4562a2451316 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:58.700416 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b866baba-3260-4516-b519-4562a2451316 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:58.700956 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b866baba-3260-4516-b519-4562a2451316 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:58.701709 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b866baba-3260-4516-b519-4562a2451316 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:58.702189 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b866baba-3260-4516-b519-4562a2451316 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:58.702614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b866baba-3260-4516-b519-4562a2451316 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:58.851237 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b866baba-3260-4516-b519-4562a2451316 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:58.859240 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b866baba-3260-4516-b519-4562a2451316 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1271 microversion: 2.1 time: 0.171299 Aug 24 11:28:58.859837 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 219/435] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:58 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:59.449813 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5c8480da-c752-4b49-8792-43ce48116e09 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:59.450503 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5c8480da-c752-4b49-8792-43ce48116e09 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:59.463981 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5c8480da-c752-4b49-8792-43ce48116e09 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:59.464476 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5c8480da-c752-4b49-8792-43ce48116e09 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:59.464920 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5c8480da-c752-4b49-8792-43ce48116e09 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:59.465689 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5c8480da-c752-4b49-8792-43ce48116e09 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:59.466158 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5c8480da-c752-4b49-8792-43ce48116e09 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:59.468052 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5c8480da-c752-4b49-8792-43ce48116e09 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:59.656637 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5c8480da-c752-4b49-8792-43ce48116e09 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:28:59.669824 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5c8480da-c752-4b49-8792-43ce48116e09 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1508 microversion: 2.1 time: 0.223864 Aug 24 11:28:59.670735 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 217/436] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:59 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:28:59.889110 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-875b4926-bd5d-4991-95ed-e0b0e6ee3a59 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:28:59.889817 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-875b4926-bd5d-4991-95ed-e0b0e6ee3a59 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:28:59.900970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-875b4926-bd5d-4991-95ed-e0b0e6ee3a59 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:59.902338 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-875b4926-bd5d-4991-95ed-e0b0e6ee3a59 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:59.903077 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-875b4926-bd5d-4991-95ed-e0b0e6ee3a59 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:28:59.904180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-875b4926-bd5d-4991-95ed-e0b0e6ee3a59 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:28:59.905117 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-875b4926-bd5d-4991-95ed-e0b0e6ee3a59 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:28:59.905793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-875b4926-bd5d-4991-95ed-e0b0e6ee3a59 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:00.124138 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-875b4926-bd5d-4991-95ed-e0b0e6ee3a59 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:00.136518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-875b4926-bd5d-4991-95ed-e0b0e6ee3a59 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1271 microversion: 2.1 time: 0.254788 Aug 24 11:29:00.138461 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 220/437] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:28:59 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1271 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:00.701126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8abb8c5a-6564-4303-953b-d44301ecf8c3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:00.701757 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8abb8c5a-6564-4303-953b-d44301ecf8c3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:00.713519 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8abb8c5a-6564-4303-953b-d44301ecf8c3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:00.714074 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8abb8c5a-6564-4303-953b-d44301ecf8c3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:00.714775 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8abb8c5a-6564-4303-953b-d44301ecf8c3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:00.717397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8abb8c5a-6564-4303-953b-d44301ecf8c3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:00.718059 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8abb8c5a-6564-4303-953b-d44301ecf8c3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:00.718864 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8abb8c5a-6564-4303-953b-d44301ecf8c3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:01.000711 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8abb8c5a-6564-4303-953b-d44301ecf8c3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:01.015073 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8abb8c5a-6564-4303-953b-d44301ecf8c3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1508 microversion: 2.1 time: 0.318062 Aug 24 11:29:01.016421 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 218/438] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:00 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1508 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:01.164868 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8a0f4324-f7c7-4bba-a6c1-c9b43967c595 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:01.166187 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8a0f4324-f7c7-4bba-a6c1-c9b43967c595 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:01.185767 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a0f4324-f7c7-4bba-a6c1-c9b43967c595 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:01.189612 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a0f4324-f7c7-4bba-a6c1-c9b43967c595 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:01.190559 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a0f4324-f7c7-4bba-a6c1-c9b43967c595 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:01.191522 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a0f4324-f7c7-4bba-a6c1-c9b43967c595 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:01.192405 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a0f4324-f7c7-4bba-a6c1-c9b43967c595 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:01.193007 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a0f4324-f7c7-4bba-a6c1-c9b43967c595 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:01.378942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8a0f4324-f7c7-4bba-a6c1-c9b43967c595 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:01.389811 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8a0f4324-f7c7-4bba-a6c1-c9b43967c595 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1271 microversion: 2.1 time: 0.230510 Aug 24 11:29:01.391051 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 221/439] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:01 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1271 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:01.660994 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-86507d67-324b-4d0e-a227-387139d58d38 req-d6d251ad-e707-4535-ac7e-43bb9ad3462a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b6e400-1d49-417d-9140-692da71f9da6", "tag": "c09687c1-5de4-4274-b42a-5caf8a2d5adb"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:01.681978 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-86507d67-324b-4d0e-a227-387139d58d38 req-d6d251ad-e707-4535-ac7e-43bb9ad3462a service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:01.682957 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-86507d67-324b-4d0e-a227-387139d58d38 req-d6d251ad-e707-4535-ac7e-43bb9ad3462a service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:01.683652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-86507d67-324b-4d0e-a227-387139d58d38 req-d6d251ad-e707-4535-ac7e-43bb9ad3462a service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:01.705393 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-86507d67-324b-4d0e-a227-387139d58d38 req-d6d251ad-e707-4535-ac7e-43bb9ad3462a service nova] Creating event network-changed:c09687c1-5de4-4274-b42a-5caf8a2d5adb for instance a9b6e400-1d49-417d-9140-692da71f9da6 on hv-cinder-85427 Aug 24 11:29:01.717935 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-86507d67-324b-4d0e-a227-387139d58d38 req-d6d251ad-e707-4535-ac7e-43bb9ad3462a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060345 Aug 24 11:29:01.719766 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 219/440] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:29:02.047638 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-75c624be-5592-4ea1-9d8e-b676f59001dd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:02.048686 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-75c624be-5592-4ea1-9d8e-b676f59001dd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:02.055120 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=50 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:02.057291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-75c624be-5592-4ea1-9d8e-b676f59001dd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:02.057988 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-75c624be-5592-4ea1-9d8e-b676f59001dd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:02.058624 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-75c624be-5592-4ea1-9d8e-b676f59001dd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:02.059716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-75c624be-5592-4ea1-9d8e-b676f59001dd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:02.060707 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-75c624be-5592-4ea1-9d8e-b676f59001dd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:02.061346 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-75c624be-5592-4ea1-9d8e-b676f59001dd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:02.280939 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-75c624be-5592-4ea1-9d8e-b676f59001dd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:02.289855 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-75c624be-5592-4ea1-9d8e-b676f59001dd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1514 microversion: 2.1 time: 0.246629 Aug 24 11:29:02.291044 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 222/441] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:02 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1514 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:02.415769 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ea89cd7a-5a89-491a-8695-2f7cd80d3e28 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:02.419830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ea89cd7a-5a89-491a-8695-2f7cd80d3e28 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:02.427760 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ea89cd7a-5a89-491a-8695-2f7cd80d3e28 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:02.428365 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ea89cd7a-5a89-491a-8695-2f7cd80d3e28 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:02.429116 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ea89cd7a-5a89-491a-8695-2f7cd80d3e28 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:02.429978 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ea89cd7a-5a89-491a-8695-2f7cd80d3e28 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:02.430489 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ea89cd7a-5a89-491a-8695-2f7cd80d3e28 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:02.430913 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ea89cd7a-5a89-491a-8695-2f7cd80d3e28 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:02.925054 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ea89cd7a-5a89-491a-8695-2f7cd80d3e28 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:02.939912 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ea89cd7a-5a89-491a-8695-2f7cd80d3e28 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.530823 Aug 24 11:29:02.940499 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 220/442] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:02 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:03.674985 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-29863f69-f277-41fb-b1f1-bab354446301 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:03.675568 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-29863f69-f277-41fb-b1f1-bab354446301 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:03.682588 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29863f69-f277-41fb-b1f1-bab354446301 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:03.683067 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29863f69-f277-41fb-b1f1-bab354446301 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:03.683499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29863f69-f277-41fb-b1f1-bab354446301 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:03.684190 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29863f69-f277-41fb-b1f1-bab354446301 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:03.684640 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29863f69-f277-41fb-b1f1-bab354446301 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:03.685066 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29863f69-f277-41fb-b1f1-bab354446301 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:03.688719 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:03.708312 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-29863f69-f277-41fb-b1f1-bab354446301 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/ips" status: 200 len: 143 microversion: 2.1 time: 0.037234 Aug 24 11:29:03.708880 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 223/443] 10.222.0.83 () {58 vars in 1248 bytes} [Wed Aug 24 11:29:03 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/ips => generated 143 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:03.965551 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-359cc169-bdb5-4ae0-825a-7249fa4b2b60 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:03.966832 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-359cc169-bdb5-4ae0-825a-7249fa4b2b60 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:03.972876 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:03.977848 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:03.977848 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-359cc169-bdb5-4ae0-825a-7249fa4b2b60 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:03.977848 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-359cc169-bdb5-4ae0-825a-7249fa4b2b60 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:03.977848 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-359cc169-bdb5-4ae0-825a-7249fa4b2b60 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:03.978270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-359cc169-bdb5-4ae0-825a-7249fa4b2b60 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:03.978270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-359cc169-bdb5-4ae0-825a-7249fa4b2b60 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:03.978270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-359cc169-bdb5-4ae0-825a-7249fa4b2b60 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:03.982177 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=100 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:04.238280 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=8 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:04.261229 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-359cc169-bdb5-4ae0-825a-7249fa4b2b60 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:04.269950 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-359cc169-bdb5-4ae0-825a-7249fa4b2b60 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.308134 Aug 24 11:29:04.270812 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 221/444] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:03 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:05.282525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6546beba-1ad6-4b8d-9635-bb47a31a9a7e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Action: 'create', calling method: .version_select at 0x7f723dabd670>, body: {"keypair": {"name": "tempest-keypair-37681819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGXmKCsRX2UDWSycbGW2d4moY54aIWHpg6sccipBgovxFtKz99losRkB6VD4yZDO4UwvfnCFOaZvyTCSv+pqTBngCpC6YYqW57zMAdrhH6igTI1Q1IeaupICyVAj8UDSw=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:05.322341 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1360aa1d-43f2-4b0d-8eba-238330068164 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:05.324787 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1360aa1d-43f2-4b0d-8eba-238330068164 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:05.344594 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1360aa1d-43f2-4b0d-8eba-238330068164 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:05.345103 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1360aa1d-43f2-4b0d-8eba-238330068164 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:05.345548 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1360aa1d-43f2-4b0d-8eba-238330068164 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:05.346303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1360aa1d-43f2-4b0d-8eba-238330068164 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:05.346763 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1360aa1d-43f2-4b0d-8eba-238330068164 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:05.347191 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1360aa1d-43f2-4b0d-8eba-238330068164 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:05.376456 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-6546beba-1ad6-4b8d-9635-bb47a31a9a7e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Getting quotas for project e2a13f3ca60643a9a3507476325d351a. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:29:05.385145 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-6546beba-1ad6-4b8d-9635-bb47a31a9a7e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Getting quotas for user 57be68e76fc14d2ca309571e284509bd and project e2a13f3ca60643a9a3507476325d351a. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:29:05.503939 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6546beba-1ad6-4b8d-9635-bb47a31a9a7e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.225782 Aug 24 11:29:05.504949 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 224/445] 10.222.0.83 () {60 vars in 1159 bytes} [Wed Aug 24 11:29:05 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:05.559087 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1360aa1d-43f2-4b0d-8eba-238330068164 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:05.570463 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1360aa1d-43f2-4b0d-8eba-238330068164 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.282301 Aug 24 11:29:05.571295 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 222/446] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:05 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:06.593600 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ad63274c-c814-4412-8ac6-bf735d3142e4 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:06.595031 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ad63274c-c814-4412-8ac6-bf735d3142e4 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:06.603340 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ad63274c-c814-4412-8ac6-bf735d3142e4 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:06.604078 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ad63274c-c814-4412-8ac6-bf735d3142e4 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:06.604860 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ad63274c-c814-4412-8ac6-bf735d3142e4 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:06.605947 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ad63274c-c814-4412-8ac6-bf735d3142e4 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:06.606840 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ad63274c-c814-4412-8ac6-bf735d3142e4 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:06.607445 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ad63274c-c814-4412-8ac6-bf735d3142e4 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:06.863459 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ad63274c-c814-4412-8ac6-bf735d3142e4 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:06.872789 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ad63274c-c814-4412-8ac6-bf735d3142e4 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.284180 Aug 24 11:29:06.887908 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 225/447] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:06 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:07.469889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-13e2aa86-f979-4373-b0ef-edd86903c89e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7735a01b-d9fe-449e-b2d4-7ba4f20e636d"}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:07.474694 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-13e2aa86-f979-4373-b0ef-edd86903c89e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:07.484753 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-13e2aa86-f979-4373-b0ef-edd86903c89e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.485756 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-13e2aa86-f979-4373-b0ef-edd86903c89e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.486372 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-13e2aa86-f979-4373-b0ef-edd86903c89e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.487604 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-13e2aa86-f979-4373-b0ef-edd86903c89e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.488359 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-13e2aa86-f979-4373-b0ef-edd86903c89e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.488972 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-13e2aa86-f979-4373-b0ef-edd86903c89e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.887210 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-db83d70c-4dc3-4978-972f-93f133e97a44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:07.887955 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-db83d70c-4dc3-4978-972f-93f133e97a44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:07.906148 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-db83d70c-4dc3-4978-972f-93f133e97a44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.907172 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-db83d70c-4dc3-4978-972f-93f133e97a44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.907683 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-db83d70c-4dc3-4978-972f-93f133e97a44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.908518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-db83d70c-4dc3-4978-972f-93f133e97a44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.909195 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-db83d70c-4dc3-4978-972f-93f133e97a44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.909647 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-db83d70c-4dc3-4978-972f-93f133e97a44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.951148 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-db83d70c-4dc3-4978-972f-93f133e97a44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06/ips" status: 200 len: 150 microversion: 2.1 time: 0.067604 Aug 24 11:29:07.952382 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 226/448] 10.222.0.83 () {58 vars in 1248 bytes} [Wed Aug 24 11:29:07 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06/ips => generated 150 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:29:07.964322 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-af5c66e3-9d40-4cad-a179-523f4245209c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:07.965526 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-af5c66e3-9d40-4cad-a179-523f4245209c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:07.974288 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af5c66e3-9d40-4cad-a179-523f4245209c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.975322 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af5c66e3-9d40-4cad-a179-523f4245209c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.975943 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af5c66e3-9d40-4cad-a179-523f4245209c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:07.976881 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af5c66e3-9d40-4cad-a179-523f4245209c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:07.977536 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af5c66e3-9d40-4cad-a179-523f4245209c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:07.978340 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af5c66e3-9d40-4cad-a179-523f4245209c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:08.233966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-af5c66e3-9d40-4cad-a179-523f4245209c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:08.243604 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-af5c66e3-9d40-4cad-a179-523f4245209c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.289249 Aug 24 11:29:08.244728 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 227/449] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:07 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:08.606903 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-13e2aa86-f979-4373-b0ef-edd86903c89e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "POST /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.145397 Aug 24 11:29:08.621187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 223/450] 10.222.0.83 () {60 vars in 1323 bytes} [Wed Aug 24 11:29:07 2022] POST /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/os-volume_attachments => generated 194 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:29:09.264951 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e0c5b6d8-3c65-4f87-8fcb-1e9ebebc345c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:09.265785 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e0c5b6d8-3c65-4f87-8fcb-1e9ebebc345c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:09.274402 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0c5b6d8-3c65-4f87-8fcb-1e9ebebc345c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:09.276743 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0c5b6d8-3c65-4f87-8fcb-1e9ebebc345c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:09.277479 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0c5b6d8-3c65-4f87-8fcb-1e9ebebc345c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:09.278543 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0c5b6d8-3c65-4f87-8fcb-1e9ebebc345c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:09.279478 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0c5b6d8-3c65-4f87-8fcb-1e9ebebc345c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:09.280184 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0c5b6d8-3c65-4f87-8fcb-1e9ebebc345c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:09.547441 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e0c5b6d8-3c65-4f87-8fcb-1e9ebebc345c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:09.557446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e0c5b6d8-3c65-4f87-8fcb-1e9ebebc345c tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.296434 Aug 24 11:29:09.558049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 228/451] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:09 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:10.032525 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1996022617", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "666ed928-684f-494a-bff2-a438190969d7"}], "security_groups": [{"name": "tempest-securitygroup--615708656"}], "key_name": "tempest-keypair-37681819", "user_data": "}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:10.409539 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] validate_networks() for [('666ed928-684f-494a-bff2-a438190969d7', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:29:10.581130 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2f5dfc13-4c59-4b77-8a44-c062fdfa2581 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:10.581993 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2f5dfc13-4c59-4b77-8a44-c062fdfa2581 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:10.591561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2f5dfc13-4c59-4b77-8a44-c062fdfa2581 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:10.595492 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2f5dfc13-4c59-4b77-8a44-c062fdfa2581 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:10.598399 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2f5dfc13-4c59-4b77-8a44-c062fdfa2581 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:10.604709 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2f5dfc13-4c59-4b77-8a44-c062fdfa2581 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:10.605529 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2f5dfc13-4c59-4b77-8a44-c062fdfa2581 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:10.616074 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2f5dfc13-4c59-4b77-8a44-c062fdfa2581 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:10.822104 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2f5dfc13-4c59-4b77-8a44-c062fdfa2581 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:10.830701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2f5dfc13-4c59-4b77-8a44-c062fdfa2581 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.253383 Aug 24 11:29:10.835615 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 229/452] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:10 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:11.264452 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-062a2ffa-34f2-4611-8f08-943a93c4be56 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b55bba1e-8387-46f6-be73-c48736710f5d"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:11.267312 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-062a2ffa-34f2-4611-8f08-943a93c4be56 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:11.288955 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-062a2ffa-34f2-4611-8f08-943a93c4be56 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:11.289740 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-062a2ffa-34f2-4611-8f08-943a93c4be56 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:11.292414 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-062a2ffa-34f2-4611-8f08-943a93c4be56 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:11.293381 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-062a2ffa-34f2-4611-8f08-943a93c4be56 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:11.294043 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-062a2ffa-34f2-4611-8f08-943a93c4be56 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:11.294805 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-062a2ffa-34f2-4611-8f08-943a93c4be56 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:11.616787 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:29:11.617294 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:29:11.617755 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:29:11.618255 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:29:11.618711 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:29:11.634111 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:11.634111 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:11.634111 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:11.635105 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:11.635754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:11.636429 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:11.660226 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Getting quotas for project e2a13f3ca60643a9a3507476325d351a. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:29:11.665178 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Getting quotas for user 57be68e76fc14d2ca309571e284509bd and project e2a13f3ca60643a9a3507476325d351a. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:29:11.689560 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:29:11.698251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:29:11.871818 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-86447646-73b3-4f1b-b6ce-1361debb9baa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.849502 Aug 24 11:29:11.872486 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 224/453] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:29:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 1853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:29:11.892943 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7e365562-a78e-4b44-9874-0b2fba47789d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:11.907293 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7e365562-a78e-4b44-9874-0b2fba47789d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:11.922399 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7e365562-a78e-4b44-9874-0b2fba47789d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:11.924927 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7e365562-a78e-4b44-9874-0b2fba47789d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:11.925648 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7e365562-a78e-4b44-9874-0b2fba47789d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:11.926638 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7e365562-a78e-4b44-9874-0b2fba47789d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:11.927326 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7e365562-a78e-4b44-9874-0b2fba47789d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:11.928024 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7e365562-a78e-4b44-9874-0b2fba47789d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:12.176976 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7e365562-a78e-4b44-9874-0b2fba47789d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:12.192929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7e365562-a78e-4b44-9874-0b2fba47789d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.304306 Aug 24 11:29:12.194715 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 225/454] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:11 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:12.202839 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7031c165-fea3-47f6-b051-df844263bafc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:12.203748 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7031c165-fea3-47f6-b051-df844263bafc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:12.286645 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7031c165-fea3-47f6-b051-df844263bafc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:12.299563 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7031c165-fea3-47f6-b051-df844263bafc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1244 microversion: 2.1 time: 0.103555 Aug 24 11:29:12.301215 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 226/455] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:12 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1244 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:12.408792 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-062a2ffa-34f2-4611-8f08-943a93c4be56 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "POST /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.147965 Aug 24 11:29:12.409424 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 230/456] 10.222.0.83 () {60 vars in 1323 bytes} [Wed Aug 24 11:29:11 2022] POST /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06/os-volume_attachments => generated 194 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:29:13.214820 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ce016f37-c581-4d67-b117-c66c49f0826d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:13.215981 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ce016f37-c581-4d67-b117-c66c49f0826d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:13.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce016f37-c581-4d67-b117-c66c49f0826d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:13.223940 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce016f37-c581-4d67-b117-c66c49f0826d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:13.224884 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce016f37-c581-4d67-b117-c66c49f0826d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:13.225575 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce016f37-c581-4d67-b117-c66c49f0826d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:13.226051 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce016f37-c581-4d67-b117-c66c49f0826d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:13.226469 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce016f37-c581-4d67-b117-c66c49f0826d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:13.329682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c870c69c-d934-4ad8-815d-4ba28c965661 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:13.330847 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c870c69c-d934-4ad8-815d-4ba28c965661 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:13.343597 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c870c69c-d934-4ad8-815d-4ba28c965661 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:13.345740 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c870c69c-d934-4ad8-815d-4ba28c965661 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:13.348645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c870c69c-d934-4ad8-815d-4ba28c965661 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:13.350842 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c870c69c-d934-4ad8-815d-4ba28c965661 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:13.356522 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c870c69c-d934-4ad8-815d-4ba28c965661 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:13.356522 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c870c69c-d934-4ad8-815d-4ba28c965661 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:13.488429 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ce016f37-c581-4d67-b117-c66c49f0826d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:13.499025 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ce016f37-c581-4d67-b117-c66c49f0826d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.288144 Aug 24 11:29:13.502895 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 227/457] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:13 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:13.507581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c870c69c-d934-4ad8-815d-4ba28c965661 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:13.519035 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c870c69c-d934-4ad8-815d-4ba28c965661 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1248 microversion: 2.1 time: 0.196178 Aug 24 11:29:13.530588 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 231/458] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:13 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1248 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:14.519640 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a67362c1-10a6-410f-9ca7-1992947c7a90 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:14.521196 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a67362c1-10a6-410f-9ca7-1992947c7a90 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:14.540634 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-78b0b198-d496-4cb0-9283-766a7b6f4ba2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:14.541458 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-78b0b198-d496-4cb0-9283-766a7b6f4ba2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:14.546806 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a67362c1-10a6-410f-9ca7-1992947c7a90 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:14.547622 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a67362c1-10a6-410f-9ca7-1992947c7a90 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:14.548245 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a67362c1-10a6-410f-9ca7-1992947c7a90 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:14.548974 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a67362c1-10a6-410f-9ca7-1992947c7a90 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:14.549471 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a67362c1-10a6-410f-9ca7-1992947c7a90 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:14.549942 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a67362c1-10a6-410f-9ca7-1992947c7a90 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:14.553504 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78b0b198-d496-4cb0-9283-766a7b6f4ba2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:14.554275 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78b0b198-d496-4cb0-9283-766a7b6f4ba2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:14.554928 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78b0b198-d496-4cb0-9283-766a7b6f4ba2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:14.558824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78b0b198-d496-4cb0-9283-766a7b6f4ba2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:14.561626 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78b0b198-d496-4cb0-9283-766a7b6f4ba2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:14.562310 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78b0b198-d496-4cb0-9283-766a7b6f4ba2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:14.734922 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-78b0b198-d496-4cb0-9283-766a7b6f4ba2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:14.747405 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-78b0b198-d496-4cb0-9283-766a7b6f4ba2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1296 microversion: 2.1 time: 0.211125 Aug 24 11:29:14.762958 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 232/459] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:14 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1296 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:14.952340 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a67362c1-10a6-410f-9ca7-1992947c7a90 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:14.962427 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a67362c1-10a6-410f-9ca7-1992947c7a90 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.446876 Aug 24 11:29:14.967098 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 228/460] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:14 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:15.770209 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-de73dda6-b233-4fbd-a939-144b76c3e75e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:15.771959 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-de73dda6-b233-4fbd-a939-144b76c3e75e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:15.777828 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=4 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:15.816576 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-de73dda6-b233-4fbd-a939-144b76c3e75e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:15.817576 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-de73dda6-b233-4fbd-a939-144b76c3e75e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:15.822342 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-de73dda6-b233-4fbd-a939-144b76c3e75e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:15.823553 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-de73dda6-b233-4fbd-a939-144b76c3e75e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:15.831553 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-de73dda6-b233-4fbd-a939-144b76c3e75e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:15.835238 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-de73dda6-b233-4fbd-a939-144b76c3e75e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:15.989441 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-44355fc5-9a9f-450a-b6cd-993235f2e576 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:15.990441 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-44355fc5-9a9f-450a-b6cd-993235f2e576 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:16.009925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-44355fc5-9a9f-450a-b6cd-993235f2e576 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:16.010716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-de73dda6-b233-4fbd-a939-144b76c3e75e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:16.011538 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-44355fc5-9a9f-450a-b6cd-993235f2e576 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:16.014130 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-44355fc5-9a9f-450a-b6cd-993235f2e576 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:16.015586 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-44355fc5-9a9f-450a-b6cd-993235f2e576 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:16.018253 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-44355fc5-9a9f-450a-b6cd-993235f2e576 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:16.024216 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-de73dda6-b233-4fbd-a939-144b76c3e75e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1302 microversion: 2.1 time: 0.258786 Aug 24 11:29:16.024878 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 233/461] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:15 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1302 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:16.025343 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-44355fc5-9a9f-450a-b6cd-993235f2e576 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:16.221323 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-44355fc5-9a9f-450a-b6cd-993235f2e576 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:16.234038 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-44355fc5-9a9f-450a-b6cd-993235f2e576 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.248255 Aug 24 11:29:16.235859 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 229/462] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:15 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:17.044694 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-36532fa9-47f2-4b71-b7bc-c18956a95aa6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:17.045389 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-36532fa9-47f2-4b71-b7bc-c18956a95aa6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:17.054471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36532fa9-47f2-4b71-b7bc-c18956a95aa6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:17.056194 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36532fa9-47f2-4b71-b7bc-c18956a95aa6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:17.058166 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36532fa9-47f2-4b71-b7bc-c18956a95aa6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:17.059506 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36532fa9-47f2-4b71-b7bc-c18956a95aa6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:17.063090 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36532fa9-47f2-4b71-b7bc-c18956a95aa6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:17.064891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36532fa9-47f2-4b71-b7bc-c18956a95aa6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:17.255640 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3379fa4c-e572-4d20-a756-a09726e19875 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:17.256354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3379fa4c-e572-4d20-a756-a09726e19875 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:17.264021 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3379fa4c-e572-4d20-a756-a09726e19875 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:17.264824 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3379fa4c-e572-4d20-a756-a09726e19875 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:17.265535 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3379fa4c-e572-4d20-a756-a09726e19875 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:17.266726 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3379fa4c-e572-4d20-a756-a09726e19875 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:17.274497 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3379fa4c-e572-4d20-a756-a09726e19875 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:17.275670 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3379fa4c-e572-4d20-a756-a09726e19875 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:17.397143 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-36532fa9-47f2-4b71-b7bc-c18956a95aa6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:17.409774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-36532fa9-47f2-4b71-b7bc-c18956a95aa6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.368890 Aug 24 11:29:17.418243 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 234/463] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:17 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:17.638796 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3379fa4c-e572-4d20-a756-a09726e19875 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:17.652134 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3379fa4c-e572-4d20-a756-a09726e19875 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.400446 Aug 24 11:29:17.653081 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 230/464] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:17 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:17.713542 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-9a053973-a488-44ea-9786-476b7b38a045 req-7e2d31ae-916a-4a4c-b42f-d12097ed0435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2aa046f-53cb-4392-9270-8f1d3b977f16", "tag": "1cedc0c3-0dae-4b5b-88b5-558ae772865a"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:17.729547 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9a053973-a488-44ea-9786-476b7b38a045 req-7e2d31ae-916a-4a4c-b42f-d12097ed0435 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:17.730422 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9a053973-a488-44ea-9786-476b7b38a045 req-7e2d31ae-916a-4a4c-b42f-d12097ed0435 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:17.731018 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9a053973-a488-44ea-9786-476b7b38a045 req-7e2d31ae-916a-4a4c-b42f-d12097ed0435 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:17.747789 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-9a053973-a488-44ea-9786-476b7b38a045 req-7e2d31ae-916a-4a4c-b42f-d12097ed0435 service nova] Creating event network-changed:1cedc0c3-0dae-4b5b-88b5-558ae772865a for instance c2aa046f-53cb-4392-9270-8f1d3b977f16 on hv-cinder-85427 Aug 24 11:29:17.754462 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-9a053973-a488-44ea-9786-476b7b38a045 req-7e2d31ae-916a-4a4c-b42f-d12097ed0435 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064451 Aug 24 11:29:17.755112 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 235/465] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:29:18.441025 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-04e6447b-d0e0-45d2-92f6-ff98ec8324c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:18.441600 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-04e6447b-d0e0-45d2-92f6-ff98ec8324c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:18.450770 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-04e6447b-d0e0-45d2-92f6-ff98ec8324c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:18.451549 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-04e6447b-d0e0-45d2-92f6-ff98ec8324c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:18.452217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-04e6447b-d0e0-45d2-92f6-ff98ec8324c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:18.453075 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-04e6447b-d0e0-45d2-92f6-ff98ec8324c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:18.454004 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-04e6447b-d0e0-45d2-92f6-ff98ec8324c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:18.455382 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-04e6447b-d0e0-45d2-92f6-ff98ec8324c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:18.675786 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3c8ff34d-0354-47af-ad61-bb92153a7490 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:18.680054 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3c8ff34d-0354-47af-ad61-bb92153a7490 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:18.705733 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c8ff34d-0354-47af-ad61-bb92153a7490 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:18.706271 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c8ff34d-0354-47af-ad61-bb92153a7490 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:18.706886 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c8ff34d-0354-47af-ad61-bb92153a7490 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:18.707611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c8ff34d-0354-47af-ad61-bb92153a7490 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:18.708069 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c8ff34d-0354-47af-ad61-bb92153a7490 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:18.709043 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c8ff34d-0354-47af-ad61-bb92153a7490 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:18.793672 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-04e6447b-d0e0-45d2-92f6-ff98ec8324c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:18.803926 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-04e6447b-d0e0-45d2-92f6-ff98ec8324c2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.369253 Aug 24 11:29:18.812756 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 231/466] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:18 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:18.813952 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b0ab2e95-6098-476e-856a-e10060d12dd2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:18.823356 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0ab2e95-6098-476e-856a-e10060d12dd2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:18.823356 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0ab2e95-6098-476e-856a-e10060d12dd2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:18.823356 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0ab2e95-6098-476e-856a-e10060d12dd2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:18.975137 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b0ab2e95-6098-476e-856a-e10060d12dd2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Going to try to stop instance {{(pid=121222) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 11:29:18.991212 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3c8ff34d-0354-47af-ad61-bb92153a7490 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:19.000545 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3c8ff34d-0354-47af-ad61-bb92153a7490 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.329910 Aug 24 11:29:19.014610 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 236/467] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:18 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:19.043971 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-53cc5f06-27a2-4300-9aa9-c57e3444c598 req-a851cb61-2d5b-470c-8d68-e6ae482a51cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b6e400-1d49-417d-9140-692da71f9da6", "name": "network-vif-plugged", "status": "completed", "tag": "c09687c1-5de4-4274-b42a-5caf8a2d5adb"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:19.058607 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-53cc5f06-27a2-4300-9aa9-c57e3444c598 req-a851cb61-2d5b-470c-8d68-e6ae482a51cb service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:19.059053 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-53cc5f06-27a2-4300-9aa9-c57e3444c598 req-a851cb61-2d5b-470c-8d68-e6ae482a51cb service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:19.059584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-53cc5f06-27a2-4300-9aa9-c57e3444c598 req-a851cb61-2d5b-470c-8d68-e6ae482a51cb service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:19.076134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-53cc5f06-27a2-4300-9aa9-c57e3444c598 req-a851cb61-2d5b-470c-8d68-e6ae482a51cb service nova] Creating event network-vif-plugged:c09687c1-5de4-4274-b42a-5caf8a2d5adb for instance a9b6e400-1d49-417d-9140-692da71f9da6 on hv-cinder-85427 Aug 24 11:29:19.082323 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-53cc5f06-27a2-4300-9aa9-c57e3444c598 req-a851cb61-2d5b-470c-8d68-e6ae482a51cb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047452 Aug 24 11:29:19.083531 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 237/468] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:19.178586 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b0ab2e95-6098-476e-856a-e10060d12dd2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "POST /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/action" status: 202 len: 0 microversion: 2.1 time: 0.363388 Aug 24 11:29:19.178586 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 232/469] 10.222.0.83 () {60 vars in 1278 bytes} [Wed Aug 24 11:29:18 2022] POST /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:29:19.190445 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4f0cb559-7929-4edf-92cc-16c224884f6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:19.191232 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4f0cb559-7929-4edf-92cc-16c224884f6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:19.211235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4f0cb559-7929-4edf-92cc-16c224884f6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:19.211746 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4f0cb559-7929-4edf-92cc-16c224884f6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:19.212475 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4f0cb559-7929-4edf-92cc-16c224884f6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:19.213779 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4f0cb559-7929-4edf-92cc-16c224884f6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:19.214320 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4f0cb559-7929-4edf-92cc-16c224884f6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:19.215074 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4f0cb559-7929-4edf-92cc-16c224884f6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:19.559651 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4f0cb559-7929-4edf-92cc-16c224884f6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:19.568878 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4f0cb559-7929-4edf-92cc-16c224884f6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.388397 Aug 24 11:29:19.569465 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 238/470] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:19 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:19.833557 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e2e89856-9e3a-47a8-816d-9e07eb7370ea tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:19.834434 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e2e89856-9e3a-47a8-816d-9e07eb7370ea tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:19.843889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e2e89856-9e3a-47a8-816d-9e07eb7370ea tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:19.844552 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e2e89856-9e3a-47a8-816d-9e07eb7370ea tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:19.845050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e2e89856-9e3a-47a8-816d-9e07eb7370ea tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:19.846283 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e2e89856-9e3a-47a8-816d-9e07eb7370ea tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:19.847046 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e2e89856-9e3a-47a8-816d-9e07eb7370ea tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:19.847784 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e2e89856-9e3a-47a8-816d-9e07eb7370ea tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:19.988783 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e2e89856-9e3a-47a8-816d-9e07eb7370ea tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:19.997412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e2e89856-9e3a-47a8-816d-9e07eb7370ea tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.170795 Aug 24 11:29:19.998023 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 233/471] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:19 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:20.023565 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b0d82235-f65c-446a-afe6-d196034b8cdb tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:20.024394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b0d82235-f65c-446a-afe6-d196034b8cdb tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:20.031755 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b0d82235-f65c-446a-afe6-d196034b8cdb tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:20.032247 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b0d82235-f65c-446a-afe6-d196034b8cdb tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:20.032688 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b0d82235-f65c-446a-afe6-d196034b8cdb tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:20.033403 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b0d82235-f65c-446a-afe6-d196034b8cdb tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:20.033881 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b0d82235-f65c-446a-afe6-d196034b8cdb tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:20.034321 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b0d82235-f65c-446a-afe6-d196034b8cdb tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:20.259448 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b0d82235-f65c-446a-afe6-d196034b8cdb tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:20.272112 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b0d82235-f65c-446a-afe6-d196034b8cdb tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.252755 Aug 24 11:29:20.303230 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 239/472] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:20 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:20.589669 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f8d7e803-229e-4a5a-9b5c-bbe96b543c85 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:20.590282 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f8d7e803-229e-4a5a-9b5c-bbe96b543c85 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:20.598463 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f8d7e803-229e-4a5a-9b5c-bbe96b543c85 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:20.599825 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f8d7e803-229e-4a5a-9b5c-bbe96b543c85 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:20.600462 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f8d7e803-229e-4a5a-9b5c-bbe96b543c85 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:20.601376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f8d7e803-229e-4a5a-9b5c-bbe96b543c85 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:20.602077 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f8d7e803-229e-4a5a-9b5c-bbe96b543c85 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:20.602660 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f8d7e803-229e-4a5a-9b5c-bbe96b543c85 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:20.797257 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f8d7e803-229e-4a5a-9b5c-bbe96b543c85 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:20.812269 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f8d7e803-229e-4a5a-9b5c-bbe96b543c85 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.226331 Aug 24 11:29:20.812854 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 234/473] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:20 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:21.019750 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5359643a-d3f3-47e2-96b8-47a84661bda3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:21.020367 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5359643a-d3f3-47e2-96b8-47a84661bda3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:21.029654 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5359643a-d3f3-47e2-96b8-47a84661bda3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:21.030288 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5359643a-d3f3-47e2-96b8-47a84661bda3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:21.030736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5359643a-d3f3-47e2-96b8-47a84661bda3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:21.031662 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5359643a-d3f3-47e2-96b8-47a84661bda3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:21.032198 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5359643a-d3f3-47e2-96b8-47a84661bda3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:21.032627 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5359643a-d3f3-47e2-96b8-47a84661bda3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:21.293365 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ba079d50-9d41-441c-b2df-1fc791014dac tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:21.294002 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ba079d50-9d41-441c-b2df-1fc791014dac tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:21.304555 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba079d50-9d41-441c-b2df-1fc791014dac tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:21.306500 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba079d50-9d41-441c-b2df-1fc791014dac tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:21.306935 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba079d50-9d41-441c-b2df-1fc791014dac tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:21.307643 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba079d50-9d41-441c-b2df-1fc791014dac tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:21.308092 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba079d50-9d41-441c-b2df-1fc791014dac tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:21.308508 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba079d50-9d41-441c-b2df-1fc791014dac tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:21.378596 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5359643a-d3f3-47e2-96b8-47a84661bda3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:21.393392 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5359643a-d3f3-47e2-96b8-47a84661bda3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.379130 Aug 24 11:29:21.413111 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 240/474] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:21 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:21.559763 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ba079d50-9d41-441c-b2df-1fc791014dac tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:21.569017 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ba079d50-9d41-441c-b2df-1fc791014dac tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.279347 Aug 24 11:29:21.582113 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 235/475] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:21 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:21.837105 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9f9d5a74-2b25-4757-a8fb-21c0dd2eae8f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:21.837535 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9f9d5a74-2b25-4757-a8fb-21c0dd2eae8f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:21.844881 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f9d5a74-2b25-4757-a8fb-21c0dd2eae8f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:21.845383 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f9d5a74-2b25-4757-a8fb-21c0dd2eae8f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:21.845805 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f9d5a74-2b25-4757-a8fb-21c0dd2eae8f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:21.846980 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f9d5a74-2b25-4757-a8fb-21c0dd2eae8f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:21.847698 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f9d5a74-2b25-4757-a8fb-21c0dd2eae8f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:21.848294 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f9d5a74-2b25-4757-a8fb-21c0dd2eae8f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:21.871857 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:22.032169 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9f9d5a74-2b25-4757-a8fb-21c0dd2eae8f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:22.048795 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9f9d5a74-2b25-4757-a8fb-21c0dd2eae8f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.217092 Aug 24 11:29:22.049783 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 241/476] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:21 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:22.420301 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-25ca894c-6cb8-4a67-a52c-866244712a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:22.420906 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-25ca894c-6cb8-4a67-a52c-866244712a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:22.433639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:22.436794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=8 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:22.443921 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-25ca894c-6cb8-4a67-a52c-866244712a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:22.445361 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-25ca894c-6cb8-4a67-a52c-866244712a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:22.446162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-25ca894c-6cb8-4a67-a52c-866244712a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:22.447408 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-25ca894c-6cb8-4a67-a52c-866244712a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:22.448348 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-25ca894c-6cb8-4a67-a52c-866244712a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:22.450757 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-25ca894c-6cb8-4a67-a52c-866244712a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:22.590735 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-60946ca5-ccae-452e-a1c1-d9f8dce992ab tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:22.592242 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-60946ca5-ccae-452e-a1c1-d9f8dce992ab tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:22.601782 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60946ca5-ccae-452e-a1c1-d9f8dce992ab tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:22.605380 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60946ca5-ccae-452e-a1c1-d9f8dce992ab tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:22.606067 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60946ca5-ccae-452e-a1c1-d9f8dce992ab tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:22.607774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60946ca5-ccae-452e-a1c1-d9f8dce992ab tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:22.608245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60946ca5-ccae-452e-a1c1-d9f8dce992ab tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:22.608665 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60946ca5-ccae-452e-a1c1-d9f8dce992ab tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:22.733865 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-25ca894c-6cb8-4a67-a52c-866244712a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:22.750385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-25ca894c-6cb8-4a67-a52c-866244712a15 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.331789 Aug 24 11:29:22.767346 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 236/477] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:22 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:22.825569 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-60946ca5-ccae-452e-a1c1-d9f8dce992ab tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:22.833595 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-60946ca5-ccae-452e-a1c1-d9f8dce992ab tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.246619 Aug 24 11:29:22.843945 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 242/478] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:22 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:23.082484 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-fc1e2902-3e6f-4ee5-bba9-2592722763f1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:23.086141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-fc1e2902-3e6f-4ee5-bba9-2592722763f1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:23.105584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc1e2902-3e6f-4ee5-bba9-2592722763f1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:23.106700 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc1e2902-3e6f-4ee5-bba9-2592722763f1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:23.108495 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc1e2902-3e6f-4ee5-bba9-2592722763f1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:23.109251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc1e2902-3e6f-4ee5-bba9-2592722763f1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:23.109715 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc1e2902-3e6f-4ee5-bba9-2592722763f1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:23.110326 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc1e2902-3e6f-4ee5-bba9-2592722763f1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:23.118546 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:23.349441 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-fc1e2902-3e6f-4ee5-bba9-2592722763f1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:23.363832 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-fc1e2902-3e6f-4ee5-bba9-2592722763f1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.289743 Aug 24 11:29:23.370042 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 237/479] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:23 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:23.791778 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d9cbce71-f665-4dcf-b049-fea7578fee4d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:23.792435 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d9cbce71-f665-4dcf-b049-fea7578fee4d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:23.803884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9cbce71-f665-4dcf-b049-fea7578fee4d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:23.804673 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9cbce71-f665-4dcf-b049-fea7578fee4d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:23.805278 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9cbce71-f665-4dcf-b049-fea7578fee4d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:23.806893 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9cbce71-f665-4dcf-b049-fea7578fee4d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:23.807797 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9cbce71-f665-4dcf-b049-fea7578fee4d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:23.808440 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9cbce71-f665-4dcf-b049-fea7578fee4d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:23.870892 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2b7b2744-1748-465e-988f-a4c6cdbd05f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:23.872063 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-2b7b2744-1748-465e-988f-a4c6cdbd05f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:23.886029 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2b7b2744-1748-465e-988f-a4c6cdbd05f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:23.886526 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2b7b2744-1748-465e-988f-a4c6cdbd05f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:23.886959 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2b7b2744-1748-465e-988f-a4c6cdbd05f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:23.887675 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2b7b2744-1748-465e-988f-a4c6cdbd05f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:23.888122 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2b7b2744-1748-465e-988f-a4c6cdbd05f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:23.888543 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2b7b2744-1748-465e-988f-a4c6cdbd05f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:24.038848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d9cbce71-f665-4dcf-b049-fea7578fee4d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:24.051121 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d9cbce71-f665-4dcf-b049-fea7578fee4d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.263387 Aug 24 11:29:24.062800 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 243/480] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:23 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:24.143559 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-2b7b2744-1748-465e-988f-a4c6cdbd05f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:24.163251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-2b7b2744-1748-465e-988f-a4c6cdbd05f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1259 microversion: 2.1 time: 0.308398 Aug 24 11:29:24.165114 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 238/481] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:23 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1259 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:24.387412 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4817d83a-cd4e-4e64-8043-47ea7d9145de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:24.388036 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4817d83a-cd4e-4e64-8043-47ea7d9145de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:24.397385 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4817d83a-cd4e-4e64-8043-47ea7d9145de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:24.397865 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4817d83a-cd4e-4e64-8043-47ea7d9145de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:24.400041 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4817d83a-cd4e-4e64-8043-47ea7d9145de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:24.401051 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4817d83a-cd4e-4e64-8043-47ea7d9145de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:24.401511 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4817d83a-cd4e-4e64-8043-47ea7d9145de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:24.403969 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4817d83a-cd4e-4e64-8043-47ea7d9145de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:24.679242 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4817d83a-cd4e-4e64-8043-47ea7d9145de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:24.718670 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4817d83a-cd4e-4e64-8043-47ea7d9145de tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.309507 Aug 24 11:29:24.719674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 244/482] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:24 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:25.073012 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a8b08890-d581-4aef-94c4-3e5f97522cec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:25.073621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a8b08890-d581-4aef-94c4-3e5f97522cec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:25.080347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a8b08890-d581-4aef-94c4-3e5f97522cec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:25.080840 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a8b08890-d581-4aef-94c4-3e5f97522cec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:25.081303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a8b08890-d581-4aef-94c4-3e5f97522cec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:25.082196 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a8b08890-d581-4aef-94c4-3e5f97522cec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:25.082719 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a8b08890-d581-4aef-94c4-3e5f97522cec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:25.083891 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a8b08890-d581-4aef-94c4-3e5f97522cec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:25.188066 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4cfa399f-0e40-48c4-b8ef-60d18df27a8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:25.188809 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4cfa399f-0e40-48c4-b8ef-60d18df27a8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:25.207084 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cfa399f-0e40-48c4-b8ef-60d18df27a8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:25.207879 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cfa399f-0e40-48c4-b8ef-60d18df27a8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:25.209057 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cfa399f-0e40-48c4-b8ef-60d18df27a8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:25.210007 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cfa399f-0e40-48c4-b8ef-60d18df27a8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:25.211513 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cfa399f-0e40-48c4-b8ef-60d18df27a8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:25.217415 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cfa399f-0e40-48c4-b8ef-60d18df27a8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:25.311248 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a8b08890-d581-4aef-94c4-3e5f97522cec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:25.325065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a8b08890-d581-4aef-94c4-3e5f97522cec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.256603 Aug 24 11:29:25.339171 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 239/483] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:25 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:25.477422 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4cfa399f-0e40-48c4-b8ef-60d18df27a8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:25.486117 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4cfa399f-0e40-48c4-b8ef-60d18df27a8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1442 microversion: 2.1 time: 0.304179 Aug 24 11:29:25.487106 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 245/484] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:25 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1442 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:25.513387 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3d4e6dc9-d12b-4a76-8e7d-3be03f0d4eef tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:25.514315 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3d4e6dc9-d12b-4a76-8e7d-3be03f0d4eef tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:25.526848 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3d4e6dc9-d12b-4a76-8e7d-3be03f0d4eef tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:25.527673 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3d4e6dc9-d12b-4a76-8e7d-3be03f0d4eef tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:25.528942 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3d4e6dc9-d12b-4a76-8e7d-3be03f0d4eef tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:25.529986 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3d4e6dc9-d12b-4a76-8e7d-3be03f0d4eef tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:25.531641 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3d4e6dc9-d12b-4a76-8e7d-3be03f0d4eef tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:25.532309 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3d4e6dc9-d12b-4a76-8e7d-3be03f0d4eef tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:25.746627 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d166c59e-c558-4038-a228-f9476a608fff tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:25.747835 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d166c59e-c558-4038-a228-f9476a608fff tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:25.756675 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3d4e6dc9-d12b-4a76-8e7d-3be03f0d4eef tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:25.767536 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d166c59e-c558-4038-a228-f9476a608fff tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:25.770355 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d166c59e-c558-4038-a228-f9476a608fff tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:25.770355 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d166c59e-c558-4038-a228-f9476a608fff tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:25.777237 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d166c59e-c558-4038-a228-f9476a608fff tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:25.778449 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d166c59e-c558-4038-a228-f9476a608fff tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:25.778599 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3d4e6dc9-d12b-4a76-8e7d-3be03f0d4eef tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1442 microversion: 2.1 time: 0.268650 Aug 24 11:29:25.779062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 240/485] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:25 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1442 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:25.779495 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d166c59e-c558-4038-a228-f9476a608fff tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:26.069915 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d166c59e-c558-4038-a228-f9476a608fff tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:26.078590 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d166c59e-c558-4038-a228-f9476a608fff tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.336541 Aug 24 11:29:26.079096 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 246/486] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:25 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:26.347380 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0f04c893-a65e-4346-8a1d-f8430241d917 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:26.348794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0f04c893-a65e-4346-8a1d-f8430241d917 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:26.356544 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f04c893-a65e-4346-8a1d-f8430241d917 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:26.357044 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f04c893-a65e-4346-8a1d-f8430241d917 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:26.357678 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f04c893-a65e-4346-8a1d-f8430241d917 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:26.361224 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f04c893-a65e-4346-8a1d-f8430241d917 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:26.362022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f04c893-a65e-4346-8a1d-f8430241d917 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:26.362609 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f04c893-a65e-4346-8a1d-f8430241d917 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:26.631269 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0f04c893-a65e-4346-8a1d-f8430241d917 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:26.640124 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0f04c893-a65e-4346-8a1d-f8430241d917 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.296734 Aug 24 11:29:26.653215 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 241/487] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:26 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:27.102006 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-44a5dae1-ec9d-4423-a590-2ef41797bbc0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:27.102625 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-44a5dae1-ec9d-4423-a590-2ef41797bbc0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:27.116340 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-44a5dae1-ec9d-4423-a590-2ef41797bbc0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:27.117120 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-44a5dae1-ec9d-4423-a590-2ef41797bbc0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:27.117748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-44a5dae1-ec9d-4423-a590-2ef41797bbc0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:27.122048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-44a5dae1-ec9d-4423-a590-2ef41797bbc0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:27.122048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-44a5dae1-ec9d-4423-a590-2ef41797bbc0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:27.122048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-44a5dae1-ec9d-4423-a590-2ef41797bbc0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:27.383163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-44a5dae1-ec9d-4423-a590-2ef41797bbc0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:27.409696 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-44a5dae1-ec9d-4423-a590-2ef41797bbc0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.313729 Aug 24 11:29:27.411308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 247/488] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:27 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:27.448256 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-a58f3c05-459c-4d9e-b9de-bb0560252779 req-15bf1044-07a4-4fd4-95cf-6136a26a7cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2aa046f-53cb-4392-9270-8f1d3b977f16", "name": "network-vif-plugged", "status": "completed", "tag": "1cedc0c3-0dae-4b5b-88b5-558ae772865a"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:27.470529 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-a58f3c05-459c-4d9e-b9de-bb0560252779 req-15bf1044-07a4-4fd4-95cf-6136a26a7cf1 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:27.471297 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-a58f3c05-459c-4d9e-b9de-bb0560252779 req-15bf1044-07a4-4fd4-95cf-6136a26a7cf1 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:27.472080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-a58f3c05-459c-4d9e-b9de-bb0560252779 req-15bf1044-07a4-4fd4-95cf-6136a26a7cf1 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:27.491268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-a58f3c05-459c-4d9e-b9de-bb0560252779 req-15bf1044-07a4-4fd4-95cf-6136a26a7cf1 service nova] Creating event network-vif-plugged:1cedc0c3-0dae-4b5b-88b5-558ae772865a for instance c2aa046f-53cb-4392-9270-8f1d3b977f16 on hv-cinder-85427 Aug 24 11:29:27.497276 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-a58f3c05-459c-4d9e-b9de-bb0560252779 req-15bf1044-07a4-4fd4-95cf-6136a26a7cf1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055228 Aug 24 11:29:27.498446 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 242/489] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:27.659931 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5cd5c873-1ca7-4faf-9185-3ee48587c39e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:27.661112 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5cd5c873-1ca7-4faf-9185-3ee48587c39e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:27.671335 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5cd5c873-1ca7-4faf-9185-3ee48587c39e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:27.672158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5cd5c873-1ca7-4faf-9185-3ee48587c39e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:27.672833 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5cd5c873-1ca7-4faf-9185-3ee48587c39e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:27.674317 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5cd5c873-1ca7-4faf-9185-3ee48587c39e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:27.675052 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5cd5c873-1ca7-4faf-9185-3ee48587c39e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:27.675564 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5cd5c873-1ca7-4faf-9185-3ee48587c39e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:27.827862 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5cd5c873-1ca7-4faf-9185-3ee48587c39e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:27.837287 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5cd5c873-1ca7-4faf-9185-3ee48587c39e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.181414 Aug 24 11:29:27.838625 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 248/490] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:27 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:28.438136 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8ed61592-a8d1-4aa6-b031-b4bf68d191eb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:28.439632 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8ed61592-a8d1-4aa6-b031-b4bf68d191eb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:28.447613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ed61592-a8d1-4aa6-b031-b4bf68d191eb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:28.449106 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ed61592-a8d1-4aa6-b031-b4bf68d191eb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:28.450329 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ed61592-a8d1-4aa6-b031-b4bf68d191eb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:28.451381 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ed61592-a8d1-4aa6-b031-b4bf68d191eb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:28.452042 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ed61592-a8d1-4aa6-b031-b4bf68d191eb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:28.452694 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ed61592-a8d1-4aa6-b031-b4bf68d191eb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:28.752104 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8ed61592-a8d1-4aa6-b031-b4bf68d191eb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:28.765340 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8ed61592-a8d1-4aa6-b031-b4bf68d191eb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.332197 Aug 24 11:29:28.766297 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 243/491] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:28 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:28.859004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-413cc48d-318c-4736-b946-30107c946993 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:28.860392 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-413cc48d-318c-4736-b946-30107c946993 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:28.870785 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-413cc48d-318c-4736-b946-30107c946993 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:28.871777 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-413cc48d-318c-4736-b946-30107c946993 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:28.872436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-413cc48d-318c-4736-b946-30107c946993 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:28.873363 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-413cc48d-318c-4736-b946-30107c946993 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:28.873903 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-413cc48d-318c-4736-b946-30107c946993 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:28.876541 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-413cc48d-318c-4736-b946-30107c946993 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:29.080830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-413cc48d-318c-4736-b946-30107c946993 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:29.089984 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-413cc48d-318c-4736-b946-30107c946993 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.234828 Aug 24 11:29:29.090965 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 249/492] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:28 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:29.594724 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-580c0793-2b67-4efb-8c39-8c861e039e2f req-8ec12573-5d11-4a3a-9eb9-5b800bcdea85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b6e400-1d49-417d-9140-692da71f9da6", "tag": "c09687c1-5de4-4274-b42a-5caf8a2d5adb"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:29.605189 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-580c0793-2b67-4efb-8c39-8c861e039e2f req-8ec12573-5d11-4a3a-9eb9-5b800bcdea85 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:29.605757 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-580c0793-2b67-4efb-8c39-8c861e039e2f req-8ec12573-5d11-4a3a-9eb9-5b800bcdea85 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:29.606280 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-580c0793-2b67-4efb-8c39-8c861e039e2f req-8ec12573-5d11-4a3a-9eb9-5b800bcdea85 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:29.617821 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-580c0793-2b67-4efb-8c39-8c861e039e2f req-8ec12573-5d11-4a3a-9eb9-5b800bcdea85 service nova] Creating event network-changed:c09687c1-5de4-4274-b42a-5caf8a2d5adb for instance a9b6e400-1d49-417d-9140-692da71f9da6 on hv-cinder-85427 Aug 24 11:29:29.630433 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-580c0793-2b67-4efb-8c39-8c861e039e2f req-8ec12573-5d11-4a3a-9eb9-5b800bcdea85 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031762 Aug 24 11:29:29.630433 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 244/493] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:29:29.787564 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8729ea88-34ee-4041-b72d-6579387f0d6b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:29.788364 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8729ea88-34ee-4041-b72d-6579387f0d6b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:29.795405 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8729ea88-34ee-4041-b72d-6579387f0d6b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:29.796447 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8729ea88-34ee-4041-b72d-6579387f0d6b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:29.797267 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8729ea88-34ee-4041-b72d-6579387f0d6b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:29.798230 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8729ea88-34ee-4041-b72d-6579387f0d6b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:29.802521 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8729ea88-34ee-4041-b72d-6579387f0d6b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:29.803366 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8729ea88-34ee-4041-b72d-6579387f0d6b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:29.983489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8729ea88-34ee-4041-b72d-6579387f0d6b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:29.992122 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8729ea88-34ee-4041-b72d-6579387f0d6b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.208744 Aug 24 11:29:29.993240 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 250/494] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:29 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:30.111997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8d2e3db4-61e2-444b-ae61-94c71a7fe8bf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:30.113118 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8d2e3db4-61e2-444b-ae61-94c71a7fe8bf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:30.119920 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8d2e3db4-61e2-444b-ae61-94c71a7fe8bf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:30.120808 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8d2e3db4-61e2-444b-ae61-94c71a7fe8bf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:30.121347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8d2e3db4-61e2-444b-ae61-94c71a7fe8bf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:30.122334 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8d2e3db4-61e2-444b-ae61-94c71a7fe8bf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:30.123008 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8d2e3db4-61e2-444b-ae61-94c71a7fe8bf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:30.123758 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8d2e3db4-61e2-444b-ae61-94c71a7fe8bf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:30.304460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8d2e3db4-61e2-444b-ae61-94c71a7fe8bf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:30.318837 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8d2e3db4-61e2-444b-ae61-94c71a7fe8bf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.211188 Aug 24 11:29:30.341071 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 245/495] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:30 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:31.012572 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-38f8e0ce-4153-46dd-b737-6875381d16e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:31.013182 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-38f8e0ce-4153-46dd-b737-6875381d16e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:31.025580 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-38f8e0ce-4153-46dd-b737-6875381d16e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.026102 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-38f8e0ce-4153-46dd-b737-6875381d16e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.026966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-38f8e0ce-4153-46dd-b737-6875381d16e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.027248 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-38f8e0ce-4153-46dd-b737-6875381d16e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.027942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-38f8e0ce-4153-46dd-b737-6875381d16e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.028549 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-38f8e0ce-4153-46dd-b737-6875381d16e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.182247 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-38f8e0ce-4153-46dd-b737-6875381d16e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:31.191613 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-38f8e0ce-4153-46dd-b737-6875381d16e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.182913 Aug 24 11:29:31.205487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 251/496] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:31 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:31.343631 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3d6367cf-3898-4193-909e-6bf73092b2c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:31.344332 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3d6367cf-3898-4193-909e-6bf73092b2c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:31.351562 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3d6367cf-3898-4193-909e-6bf73092b2c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.352274 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3d6367cf-3898-4193-909e-6bf73092b2c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.352871 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3d6367cf-3898-4193-909e-6bf73092b2c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.353744 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3d6367cf-3898-4193-909e-6bf73092b2c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:31.354255 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3d6367cf-3898-4193-909e-6bf73092b2c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:31.354677 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3d6367cf-3898-4193-909e-6bf73092b2c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:31.512525 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3d6367cf-3898-4193-909e-6bf73092b2c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:31.521369 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3d6367cf-3898-4193-909e-6bf73092b2c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.181482 Aug 24 11:29:31.521967 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 246/497] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:31 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:32.213029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8ceae5f1-6b07-474b-9002-5c0231ad0d89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:32.213646 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8ceae5f1-6b07-474b-9002-5c0231ad0d89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:32.216165 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:32.221295 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ceae5f1-6b07-474b-9002-5c0231ad0d89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.222356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ceae5f1-6b07-474b-9002-5c0231ad0d89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.222356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ceae5f1-6b07-474b-9002-5c0231ad0d89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.223160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ceae5f1-6b07-474b-9002-5c0231ad0d89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.223622 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ceae5f1-6b07-474b-9002-5c0231ad0d89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.224055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ceae5f1-6b07-474b-9002-5c0231ad0d89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.368520 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8ceae5f1-6b07-474b-9002-5c0231ad0d89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:32.378038 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8ceae5f1-6b07-474b-9002-5c0231ad0d89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.168903 Aug 24 11:29:32.378634 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 252/498] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:32 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:32.542354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-721a4522-5ae5-40f1-8c31-d33e1d599bf7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:32.542969 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-721a4522-5ae5-40f1-8c31-d33e1d599bf7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:32.549594 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-721a4522-5ae5-40f1-8c31-d33e1d599bf7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.550113 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-721a4522-5ae5-40f1-8c31-d33e1d599bf7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.550554 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-721a4522-5ae5-40f1-8c31-d33e1d599bf7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.551818 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-721a4522-5ae5-40f1-8c31-d33e1d599bf7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:32.552286 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-721a4522-5ae5-40f1-8c31-d33e1d599bf7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:32.552712 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-721a4522-5ae5-40f1-8c31-d33e1d599bf7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:32.688211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-721a4522-5ae5-40f1-8c31-d33e1d599bf7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:32.695915 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-721a4522-5ae5-40f1-8c31-d33e1d599bf7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.157414 Aug 24 11:29:32.696479 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 247/499] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:32 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:33.400933 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f1964030-4f0f-45c7-a201-53120a72767f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:33.401661 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f1964030-4f0f-45c7-a201-53120a72767f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:33.409077 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1964030-4f0f-45c7-a201-53120a72767f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.409577 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1964030-4f0f-45c7-a201-53120a72767f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.410164 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1964030-4f0f-45c7-a201-53120a72767f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.411013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1964030-4f0f-45c7-a201-53120a72767f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.411895 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1964030-4f0f-45c7-a201-53120a72767f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.412337 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1964030-4f0f-45c7-a201-53120a72767f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.562437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f1964030-4f0f-45c7-a201-53120a72767f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:33.570606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f1964030-4f0f-45c7-a201-53120a72767f tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.173838 Aug 24 11:29:33.571348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 253/500] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:33 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:33.716153 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9e56f1b2-9a52-4edf-a737-8f0d9b802bfa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:33.718334 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9e56f1b2-9a52-4edf-a737-8f0d9b802bfa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:33.723745 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e56f1b2-9a52-4edf-a737-8f0d9b802bfa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.724229 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e56f1b2-9a52-4edf-a737-8f0d9b802bfa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.724662 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e56f1b2-9a52-4edf-a737-8f0d9b802bfa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.725352 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e56f1b2-9a52-4edf-a737-8f0d9b802bfa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:33.725806 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e56f1b2-9a52-4edf-a737-8f0d9b802bfa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:33.726250 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e56f1b2-9a52-4edf-a737-8f0d9b802bfa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:33.861929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9e56f1b2-9a52-4edf-a737-8f0d9b802bfa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:33.869673 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9e56f1b2-9a52-4edf-a737-8f0d9b802bfa tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.157396 Aug 24 11:29:33.870271 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 248/501] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:33 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:34.011206 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7bc66f05-09c4-4df0-8eae-f6042d7aaae4 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Action: 'create', calling method: .version_select at 0x7f723d962a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1384024659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwRLaMkzMADlinTokE8kE/DKNtY40XX64ejZCEyWnyzlMGH943bq5Abm9FKPutR/Er5eM1rzvGHtbjKCvbL5r7lvy8rX69mY348XCUpao9cJBwnXJW4yJOju3X8v240OQ=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:34.029290 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-7bc66f05-09c4-4df0-8eae-f6042d7aaae4 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Getting quotas for project 7e02d1127ce24c20822ab10c78edb00b. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:29:34.033994 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-7bc66f05-09c4-4df0-8eae-f6042d7aaae4 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Getting quotas for user 413dcd64b46f4e10947d9347dff434cc and project 7e02d1127ce24c20822ab10c78edb00b. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:29:34.141232 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7bc66f05-09c4-4df0-8eae-f6042d7aaae4 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.134974 Aug 24 11:29:34.141842 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 254/502] 10.222.0.83 () {60 vars in 1159 bytes} [Wed Aug 24 11:29:34 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:34.240750 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-83856034", "imageRef": "9e20b5ac-844c-4b6c-8a3c-5ef448d5567b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1384024659", "networks": [{"uuid": "04ac9b16-0b41-4f44-8624-a82e1685f95a"}]}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:34.248739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:34.292240 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] validate_networks() for [('04ac9b16-0b41-4f44-8624-a82e1685f95a', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:29:34.592815 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a204e025-c103-4a8a-9e07-cc37caaa23be tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:34.594268 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a204e025-c103-4a8a-9e07-cc37caaa23be tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:34.601313 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a204e025-c103-4a8a-9e07-cc37caaa23be tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:34.608484 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a204e025-c103-4a8a-9e07-cc37caaa23be tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:34.608484 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a204e025-c103-4a8a-9e07-cc37caaa23be tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:34.608484 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a204e025-c103-4a8a-9e07-cc37caaa23be tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:34.608484 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a204e025-c103-4a8a-9e07-cc37caaa23be tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:34.608811 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a204e025-c103-4a8a-9e07-cc37caaa23be tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:34.686988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:29:34.687478 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:29:34.688118 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:29:34.688590 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:29:34.689600 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:29:34.698794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:34.699267 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:34.699692 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:34.700437 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:34.700880 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:34.701295 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:34.720072 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Getting quotas for project 7e02d1127ce24c20822ab10c78edb00b. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:29:34.724653 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Getting quotas for user 413dcd64b46f4e10947d9347dff434cc and project 7e02d1127ce24c20822ab10c78edb00b. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:29:34.736243 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:29:34.738741 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e20b5ac-844c-4b6c-8a3c-5ef448d5567b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:29:34.758684 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a204e025-c103-4a8a-9e07-cc37caaa23be tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:34.768429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a204e025-c103-4a8a-9e07-cc37caaa23be tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.179392 Aug 24 11:29:34.769147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 255/503] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:34 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:34.783119 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ff09de73-e20c-4fb8-9771-67c20d62524b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Action: 'create', calling method: .version_select at 0x7f723d976ee0>, body: {"keypair": {"name": "tempest-keypair-162066702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqUQSClNV1liGirWZpVhUvJUXzswVlASzpVAMkQjncI1rXZaUZCcbOCFgLOceXG6Kn98bPh/ZE0GGvq1kz360UlW8kaOYIgUsic94k8daQKGLWXEhWcWagHDohn2wTU1w=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:34.798796 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-ff09de73-e20c-4fb8-9771-67c20d62524b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for project 6e41187605624091a4edc1993c4357e4. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:29:34.802758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-ff09de73-e20c-4fb8-9771-67c20d62524b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for user 92712c36310c440c94da6c432c77a895 and project 6e41187605624091a4edc1993c4357e4. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:29:34.891239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-180fb1da-d35d-40be-bbfb-8bf547292391 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654857 Aug 24 11:29:34.891888 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 249/504] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:29:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:29:34.897070 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-755944e5-291a-45be-9a09-05a0880549de tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:34.898133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-755944e5-291a-45be-9a09-05a0880549de tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:34.906159 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-755944e5-291a-45be-9a09-05a0880549de tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:34.906944 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-755944e5-291a-45be-9a09-05a0880549de tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:34.910195 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-755944e5-291a-45be-9a09-05a0880549de tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:34.910195 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-755944e5-291a-45be-9a09-05a0880549de tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:34.910195 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-755944e5-291a-45be-9a09-05a0880549de tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:34.910195 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-755944e5-291a-45be-9a09-05a0880549de tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:34.930098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ff09de73-e20c-4fb8-9771-67c20d62524b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.152416 Aug 24 11:29:34.931099 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 256/505] 10.222.0.83 () {60 vars in 1159 bytes} [Wed Aug 24 11:29:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:34.939362 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5746e73a-213a-45d7-9492-3fb35b417d53 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:34.939362 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5746e73a-213a-45d7-9492-3fb35b417d53 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:35.000603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5746e73a-213a-45d7-9492-3fb35b417d53 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:35.010638 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5746e73a-213a-45d7-9492-3fb35b417d53 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1257 microversion: 2.1 time: 0.078654 Aug 24 11:29:35.011301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 257/506] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:34 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1257 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:35.178614 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-755944e5-291a-45be-9a09-05a0880549de tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:35.194744 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-755944e5-291a-45be-9a09-05a0880549de tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.301711 Aug 24 11:29:35.195747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 250/507] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:34 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:35.790810 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c3dee6aa-2862-4b89-8b88-9849faada472 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:35.791424 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c3dee6aa-2862-4b89-8b88-9849faada472 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:35.798762 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3dee6aa-2862-4b89-8b88-9849faada472 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.799343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3dee6aa-2862-4b89-8b88-9849faada472 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.799879 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3dee6aa-2862-4b89-8b88-9849faada472 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.801914 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3dee6aa-2862-4b89-8b88-9849faada472 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:35.802552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3dee6aa-2862-4b89-8b88-9849faada472 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:35.802979 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3dee6aa-2862-4b89-8b88-9849faada472 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:35.941311 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c3dee6aa-2862-4b89-8b88-9849faada472 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:35.949975 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c3dee6aa-2862-4b89-8b88-9849faada472 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.162957 Aug 24 11:29:35.950539 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 258/508] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:35 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:36.032332 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-cb759f0e-ce93-4fa4-a6ab-d319cb2c285b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:36.032855 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-cb759f0e-ce93-4fa4-a6ab-d319cb2c285b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:36.096875 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-cb759f0e-ce93-4fa4-a6ab-d319cb2c285b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:36.104565 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-cb759f0e-ce93-4fa4-a6ab-d319cb2c285b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1257 microversion: 2.1 time: 0.076355 Aug 24 11:29:36.105076 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 251/509] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:36 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1257 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:36.216554 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2fdc69bd-60c0-4ffe-b834-27d5e740ff82 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:36.217195 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2fdc69bd-60c0-4ffe-b834-27d5e740ff82 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:36.223741 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2fdc69bd-60c0-4ffe-b834-27d5e740ff82 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:36.224233 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2fdc69bd-60c0-4ffe-b834-27d5e740ff82 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:36.224639 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2fdc69bd-60c0-4ffe-b834-27d5e740ff82 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:36.225334 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2fdc69bd-60c0-4ffe-b834-27d5e740ff82 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:36.225779 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2fdc69bd-60c0-4ffe-b834-27d5e740ff82 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:36.226218 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2fdc69bd-60c0-4ffe-b834-27d5e740ff82 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:36.391298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2fdc69bd-60c0-4ffe-b834-27d5e740ff82 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:36.399663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2fdc69bd-60c0-4ffe-b834-27d5e740ff82 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1369 microversion: 2.1 time: 0.186950 Aug 24 11:29:36.400241 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 259/510] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:36 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1369 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:36.971165 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1b1db983-90d4-48a0-a985-b693bc740ef9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:36.971779 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1b1db983-90d4-48a0-a985-b693bc740ef9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:36.978703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1b1db983-90d4-48a0-a985-b693bc740ef9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:36.979195 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1b1db983-90d4-48a0-a985-b693bc740ef9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:36.979637 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1b1db983-90d4-48a0-a985-b693bc740ef9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:36.980349 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1b1db983-90d4-48a0-a985-b693bc740ef9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:36.980811 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1b1db983-90d4-48a0-a985-b693bc740ef9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:36.981238 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1b1db983-90d4-48a0-a985-b693bc740ef9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.122244 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1b1db983-90d4-48a0-a985-b693bc740ef9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:37.126887 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a5c26063-31df-441c-9db2-aa633e79a127 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:37.127511 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a5c26063-31df-441c-9db2-aa633e79a127 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:37.134232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1b1db983-90d4-48a0-a985-b693bc740ef9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.166857 Aug 24 11:29:37.134396 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a5c26063-31df-441c-9db2-aa633e79a127 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:37.134722 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a5c26063-31df-441c-9db2-aa633e79a127 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:37.135162 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a5c26063-31df-441c-9db2-aa633e79a127 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.135863 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a5c26063-31df-441c-9db2-aa633e79a127 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:37.136496 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a5c26063-31df-441c-9db2-aa633e79a127 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:37.136927 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a5c26063-31df-441c-9db2-aa633e79a127 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.147374 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 252/511] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:36 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:37.245993 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a5c26063-31df-441c-9db2-aa633e79a127 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:37.254024 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a5c26063-31df-441c-9db2-aa633e79a127 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1261 microversion: 2.1 time: 0.133242 Aug 24 11:29:37.254606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 260/512] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:37 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1261 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:37.420679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a55d4001-80b7-45db-913b-c30fe690a145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:37.421339 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a55d4001-80b7-45db-913b-c30fe690a145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:37.427719 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a55d4001-80b7-45db-913b-c30fe690a145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:37.428200 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a55d4001-80b7-45db-913b-c30fe690a145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:37.429334 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a55d4001-80b7-45db-913b-c30fe690a145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.429334 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a55d4001-80b7-45db-913b-c30fe690a145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:37.429815 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a55d4001-80b7-45db-913b-c30fe690a145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:37.430252 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a55d4001-80b7-45db-913b-c30fe690a145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.572260 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a55d4001-80b7-45db-913b-c30fe690a145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:37.580036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a55d4001-80b7-45db-913b-c30fe690a145 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1563 microversion: 2.1 time: 0.163313 Aug 24 11:29:37.580605 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 253/513] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:37 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:37.601527 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5cfb56eb-5ede-4619-aec7-421b4d350434 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:37.602546 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5cfb56eb-5ede-4619-aec7-421b4d350434 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:37.608746 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5cfb56eb-5ede-4619-aec7-421b4d350434 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:37.609237 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5cfb56eb-5ede-4619-aec7-421b4d350434 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:37.609676 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5cfb56eb-5ede-4619-aec7-421b4d350434 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.610419 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5cfb56eb-5ede-4619-aec7-421b4d350434 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:37.610876 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5cfb56eb-5ede-4619-aec7-421b4d350434 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:37.611307 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5cfb56eb-5ede-4619-aec7-421b4d350434 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:37.615224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:37.715054 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5cfb56eb-5ede-4619-aec7-421b4d350434 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118064 Aug 24 11:29:37.715670 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 261/514] 10.222.0.83 () {58 vars in 1275 bytes} [Wed Aug 24 11:29:37 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:29:37.877956 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-300789186", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e65e35e5-b291-45e0-99cd-ea04855e4be5"}], "security_groups": [{"name": "tempest-securitygroup--511696947"}], "key_name": "tempest-keypair-162066702", "user_data": "}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:38.009777 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] validate_networks() for [('e65e35e5-b291-45e0-99cd-ea04855e4be5', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:29:38.157381 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e922fafb-95e0-4ec1-99f3-3088a281ba99 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:38.158105 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e922fafb-95e0-4ec1-99f3-3088a281ba99 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:38.164661 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e922fafb-95e0-4ec1-99f3-3088a281ba99 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:38.165142 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e922fafb-95e0-4ec1-99f3-3088a281ba99 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:38.165572 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e922fafb-95e0-4ec1-99f3-3088a281ba99 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:38.166304 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e922fafb-95e0-4ec1-99f3-3088a281ba99 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:38.166751 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e922fafb-95e0-4ec1-99f3-3088a281ba99 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:38.167173 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e922fafb-95e0-4ec1-99f3-3088a281ba99 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:38.300638 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e922fafb-95e0-4ec1-99f3-3088a281ba99 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:38.309763 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e922fafb-95e0-4ec1-99f3-3088a281ba99 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.156934 Aug 24 11:29:38.310383 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 262/515] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:38 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:38.328280 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-33f041f1-702a-4c60-80c9-ada97b1c61a8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:38.328280 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-33f041f1-702a-4c60-80c9-ada97b1c61a8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:38.328280 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33f041f1-702a-4c60-80c9-ada97b1c61a8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:38.328280 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33f041f1-702a-4c60-80c9-ada97b1c61a8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:38.328669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33f041f1-702a-4c60-80c9-ada97b1c61a8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:38.328669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33f041f1-702a-4c60-80c9-ada97b1c61a8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:38.328669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33f041f1-702a-4c60-80c9-ada97b1c61a8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:38.328669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33f041f1-702a-4c60-80c9-ada97b1c61a8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:38.386298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-33f041f1-702a-4c60-80c9-ada97b1c61a8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:38.394150 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-33f041f1-702a-4c60-80c9-ada97b1c61a8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1261 microversion: 2.1 time: 0.082707 Aug 24 11:29:38.395231 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 263/516] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:38 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:38.980493 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:29:38.981008 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:29:38.981525 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:29:38.981967 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:29:38.982388 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:29:38.991295 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:38.991788 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:38.992225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:38.992961 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:38.993446 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:38.994072 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:39.011554 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for project 6e41187605624091a4edc1993c4357e4. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:29:39.015491 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for user 92712c36310c440c94da6c432c77a895 and project 6e41187605624091a4edc1993c4357e4. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:29:39.027765 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:29:39.029986 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:29:39.171902 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-383af400-a4e2-411a-be94-d73840e98200 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.297730 Aug 24 11:29:39.179093 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 254/517] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:29:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:29:39.188724 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-04e3d2a2-f167-4d75-862c-6958d54343d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:39.188724 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-04e3d2a2-f167-4d75-862c-6958d54343d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:39.252373 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-02904be1-a9e8-40c0-ae90-5b415594f293 req-788dcc6e-af6c-404a-968a-e4e460a73415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2aa046f-53cb-4392-9270-8f1d3b977f16", "tag": "1cedc0c3-0dae-4b5b-88b5-558ae772865a"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:39.264076 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-04e3d2a2-f167-4d75-862c-6958d54343d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:39.274118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-04e3d2a2-f167-4d75-862c-6958d54343d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1240 microversion: 2.1 time: 0.092029 Aug 24 11:29:39.277111 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-02904be1-a9e8-40c0-ae90-5b415594f293 req-788dcc6e-af6c-404a-968a-e4e460a73415 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:39.277598 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 264/518] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:39 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:39.278559 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-02904be1-a9e8-40c0-ae90-5b415594f293 req-788dcc6e-af6c-404a-968a-e4e460a73415 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:39.279510 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-02904be1-a9e8-40c0-ae90-5b415594f293 req-788dcc6e-af6c-404a-968a-e4e460a73415 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:39.296006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-02904be1-a9e8-40c0-ae90-5b415594f293 req-788dcc6e-af6c-404a-968a-e4e460a73415 service nova] Creating event network-changed:1cedc0c3-0dae-4b5b-88b5-558ae772865a for instance c2aa046f-53cb-4392-9270-8f1d3b977f16 on hv-cinder-85427 Aug 24 11:29:39.302206 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-02904be1-a9e8-40c0-ae90-5b415594f293 req-788dcc6e-af6c-404a-968a-e4e460a73415 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053504 Aug 24 11:29:39.302810 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 255/519] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:29:39.335588 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-96185ee5-77f4-4265-ba0a-f924ee4e976a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:39.336396 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-96185ee5-77f4-4265-ba0a-f924ee4e976a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:39.343411 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96185ee5-77f4-4265-ba0a-f924ee4e976a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:39.343876 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96185ee5-77f4-4265-ba0a-f924ee4e976a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:39.344304 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96185ee5-77f4-4265-ba0a-f924ee4e976a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:39.345024 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96185ee5-77f4-4265-ba0a-f924ee4e976a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:39.345474 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96185ee5-77f4-4265-ba0a-f924ee4e976a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:39.345937 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96185ee5-77f4-4265-ba0a-f924ee4e976a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:39.421460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a405b8ac-0a62-4f26-af18-2b992a4ef048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:39.423315 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a405b8ac-0a62-4f26-af18-2b992a4ef048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:39.434514 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a405b8ac-0a62-4f26-af18-2b992a4ef048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:39.442032 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a405b8ac-0a62-4f26-af18-2b992a4ef048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:39.442032 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a405b8ac-0a62-4f26-af18-2b992a4ef048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:39.442032 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a405b8ac-0a62-4f26-af18-2b992a4ef048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:39.442032 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a405b8ac-0a62-4f26-af18-2b992a4ef048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:39.442532 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a405b8ac-0a62-4f26-af18-2b992a4ef048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:39.500505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-96185ee5-77f4-4265-ba0a-f924ee4e976a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:39.512785 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a405b8ac-0a62-4f26-af18-2b992a4ef048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:39.514063 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-96185ee5-77f4-4265-ba0a-f924ee4e976a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.182707 Aug 24 11:29:39.515214 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 265/520] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:39 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:39.524734 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a405b8ac-0a62-4f26-af18-2b992a4ef048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1261 microversion: 2.1 time: 0.111360 Aug 24 11:29:39.527673 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 256/521] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:39 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1261 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:40.295592 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-04e0ead1-6f0e-44c5-81e5-ac2a83b61385 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:40.296497 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-04e0ead1-6f0e-44c5-81e5-ac2a83b61385 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:40.304186 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-04e0ead1-6f0e-44c5-81e5-ac2a83b61385 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:40.304668 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-04e0ead1-6f0e-44c5-81e5-ac2a83b61385 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:40.305097 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-04e0ead1-6f0e-44c5-81e5-ac2a83b61385 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:40.305787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-04e0ead1-6f0e-44c5-81e5-ac2a83b61385 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:40.306268 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-04e0ead1-6f0e-44c5-81e5-ac2a83b61385 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:40.306762 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-04e0ead1-6f0e-44c5-81e5-ac2a83b61385 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:40.372394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-04e0ead1-6f0e-44c5-81e5-ac2a83b61385 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:40.380720 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-04e0ead1-6f0e-44c5-81e5-ac2a83b61385 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1244 microversion: 2.1 time: 0.089159 Aug 24 11:29:40.381292 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 266/522] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:40 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:40.536569 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4b9d3051-fbf2-4d78-95fb-aa5dccd887e6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:40.537223 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4b9d3051-fbf2-4d78-95fb-aa5dccd887e6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:40.543971 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4b9d3051-fbf2-4d78-95fb-aa5dccd887e6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:40.544705 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4b9d3051-fbf2-4d78-95fb-aa5dccd887e6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:40.545146 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4b9d3051-fbf2-4d78-95fb-aa5dccd887e6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:40.545581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b5787cff-05bf-4f43-af05-a4eed3701f27 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:40.546094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4b9d3051-fbf2-4d78-95fb-aa5dccd887e6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:40.546211 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b5787cff-05bf-4f43-af05-a4eed3701f27 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:40.546500 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4b9d3051-fbf2-4d78-95fb-aa5dccd887e6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:40.546933 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4b9d3051-fbf2-4d78-95fb-aa5dccd887e6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:40.554548 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b5787cff-05bf-4f43-af05-a4eed3701f27 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:40.556925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b5787cff-05bf-4f43-af05-a4eed3701f27 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:40.556925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b5787cff-05bf-4f43-af05-a4eed3701f27 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:40.556925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b5787cff-05bf-4f43-af05-a4eed3701f27 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:40.557310 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b5787cff-05bf-4f43-af05-a4eed3701f27 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:40.557908 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b5787cff-05bf-4f43-af05-a4eed3701f27 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:40.649899 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b5787cff-05bf-4f43-af05-a4eed3701f27 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:40.657998 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b5787cff-05bf-4f43-af05-a4eed3701f27 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1261 microversion: 2.1 time: 0.117032 Aug 24 11:29:40.658766 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 267/523] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:40 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1261 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:40.784744 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4b9d3051-fbf2-4d78-95fb-aa5dccd887e6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:40.796968 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4b9d3051-fbf2-4d78-95fb-aa5dccd887e6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.264174 Aug 24 11:29:40.797580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 257/524] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:40 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:41.401041 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b838dfee-a10b-4df8-9cbb-2240f5609e8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:41.401692 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b838dfee-a10b-4df8-9cbb-2240f5609e8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:41.408648 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b838dfee-a10b-4df8-9cbb-2240f5609e8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:41.409064 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b838dfee-a10b-4df8-9cbb-2240f5609e8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:41.409499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b838dfee-a10b-4df8-9cbb-2240f5609e8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:41.410231 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b838dfee-a10b-4df8-9cbb-2240f5609e8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:41.410686 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b838dfee-a10b-4df8-9cbb-2240f5609e8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:41.411107 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b838dfee-a10b-4df8-9cbb-2240f5609e8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:41.588637 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b838dfee-a10b-4df8-9cbb-2240f5609e8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:41.596342 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b838dfee-a10b-4df8-9cbb-2240f5609e8a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1292 microversion: 2.1 time: 0.199157 Aug 24 11:29:41.596914 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 268/525] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:41 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1292 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:41.680231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d5f72aa6-f111-4a33-84cd-e064f5d595dc tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:41.681696 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d5f72aa6-f111-4a33-84cd-e064f5d595dc tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:41.688670 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d5f72aa6-f111-4a33-84cd-e064f5d595dc tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:41.689163 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d5f72aa6-f111-4a33-84cd-e064f5d595dc tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:41.689633 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d5f72aa6-f111-4a33-84cd-e064f5d595dc tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:41.690369 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d5f72aa6-f111-4a33-84cd-e064f5d595dc tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:41.690822 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d5f72aa6-f111-4a33-84cd-e064f5d595dc tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:41.691687 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d5f72aa6-f111-4a33-84cd-e064f5d595dc tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:41.698277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=100 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:41.764041 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d5f72aa6-f111-4a33-84cd-e064f5d595dc tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:41.772193 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d5f72aa6-f111-4a33-84cd-e064f5d595dc tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1309 microversion: 2.1 time: 0.096624 Aug 24 11:29:41.773091 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 258/526] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:41 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:41.818366 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-93af6a58-603f-483a-9020-f8112ce664c2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:41.819001 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-93af6a58-603f-483a-9020-f8112ce664c2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:41.825332 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93af6a58-603f-483a-9020-f8112ce664c2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:41.826573 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93af6a58-603f-483a-9020-f8112ce664c2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:41.827235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93af6a58-603f-483a-9020-f8112ce664c2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:41.828029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93af6a58-603f-483a-9020-f8112ce664c2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:41.830008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93af6a58-603f-483a-9020-f8112ce664c2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:41.830582 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93af6a58-603f-483a-9020-f8112ce664c2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:41.965695 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-93af6a58-603f-483a-9020-f8112ce664c2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:41.974454 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-93af6a58-603f-483a-9020-f8112ce664c2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1719 microversion: 2.1 time: 0.159968 Aug 24 11:29:41.975013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 269/527] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:41 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:42.616743 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-95790873-7a69-4390-8252-e8ab4479d135 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:42.617347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-95790873-7a69-4390-8252-e8ab4479d135 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:42.623906 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-95790873-7a69-4390-8252-e8ab4479d135 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:42.624405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-95790873-7a69-4390-8252-e8ab4479d135 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:42.624845 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-95790873-7a69-4390-8252-e8ab4479d135 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:42.625515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-95790873-7a69-4390-8252-e8ab4479d135 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:42.625990 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-95790873-7a69-4390-8252-e8ab4479d135 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:42.626406 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-95790873-7a69-4390-8252-e8ab4479d135 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:42.794373 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-58deb0a4-c76e-4f2b-bd0b-070092b7a048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:42.795569 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-58deb0a4-c76e-4f2b-bd0b-070092b7a048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:42.802287 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-58deb0a4-c76e-4f2b-bd0b-070092b7a048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:42.802775 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-58deb0a4-c76e-4f2b-bd0b-070092b7a048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:42.803408 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-58deb0a4-c76e-4f2b-bd0b-070092b7a048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:42.804272 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-58deb0a4-c76e-4f2b-bd0b-070092b7a048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:42.804726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-58deb0a4-c76e-4f2b-bd0b-070092b7a048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:42.805148 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-58deb0a4-c76e-4f2b-bd0b-070092b7a048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:42.819970 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-95790873-7a69-4390-8252-e8ab4479d135 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:42.834035 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-95790873-7a69-4390-8252-e8ab4479d135 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1300 microversion: 2.1 time: 0.220500 Aug 24 11:29:42.834546 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 259/528] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:42 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1300 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:42.871213 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-58deb0a4-c76e-4f2b-bd0b-070092b7a048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:42.879627 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-58deb0a4-c76e-4f2b-bd0b-070092b7a048 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1315 microversion: 2.1 time: 0.088482 Aug 24 11:29:42.880216 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 270/529] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:42 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1315 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:42.995658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-86303718-4274-4c81-b4db-cf41eeeeb7f0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:42.996420 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-86303718-4274-4c81-b4db-cf41eeeeb7f0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:43.002682 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-86303718-4274-4c81-b4db-cf41eeeeb7f0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:43.003173 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-86303718-4274-4c81-b4db-cf41eeeeb7f0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:43.003616 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-86303718-4274-4c81-b4db-cf41eeeeb7f0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:43.004885 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-86303718-4274-4c81-b4db-cf41eeeeb7f0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:43.005340 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-86303718-4274-4c81-b4db-cf41eeeeb7f0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:43.005769 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-86303718-4274-4c81-b4db-cf41eeeeb7f0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:43.239801 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-86303718-4274-4c81-b4db-cf41eeeeb7f0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:43.249236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-86303718-4274-4c81-b4db-cf41eeeeb7f0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1696 microversion: 2.1 time: 0.257477 Aug 24 11:29:43.249817 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 260/530] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:42 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1696 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:43.269736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9e29cac6-317a-4ce1-a5c2-804dab97aec5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:43.275968 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e29cac6-317a-4ce1-a5c2-804dab97aec5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:43.276463 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e29cac6-317a-4ce1-a5c2-804dab97aec5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:43.276902 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e29cac6-317a-4ce1-a5c2-804dab97aec5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:43.339031 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9e29cac6-317a-4ce1-a5c2-804dab97aec5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Going to try to start instance {{(pid=121221) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 11:29:43.513754 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9e29cac6-317a-4ce1-a5c2-804dab97aec5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "POST /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/action" status: 202 len: 0 microversion: 2.1 time: 0.247705 Aug 24 11:29:43.514585 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 271/531] 10.222.0.83 () {60 vars in 1278 bytes} [Wed Aug 24 11:29:43 2022] POST /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:29:43.523471 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c868da2d-67fc-413a-a163-4dbb30df78a3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:43.524156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c868da2d-67fc-413a-a163-4dbb30df78a3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:43.530430 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c868da2d-67fc-413a-a163-4dbb30df78a3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:43.530912 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c868da2d-67fc-413a-a163-4dbb30df78a3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:43.531374 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c868da2d-67fc-413a-a163-4dbb30df78a3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:43.532057 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c868da2d-67fc-413a-a163-4dbb30df78a3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:43.532510 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c868da2d-67fc-413a-a163-4dbb30df78a3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:43.532930 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c868da2d-67fc-413a-a163-4dbb30df78a3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:43.670239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c868da2d-67fc-413a-a163-4dbb30df78a3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:43.678493 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c868da2d-67fc-413a-a163-4dbb30df78a3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.159498 Aug 24 11:29:43.679088 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 261/532] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:43 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:43.861233 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6c3f3892-b27a-41d9-984d-2718b3a84137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:43.861970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6c3f3892-b27a-41d9-984d-2718b3a84137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:43.868132 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c3f3892-b27a-41d9-984d-2718b3a84137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:43.868607 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c3f3892-b27a-41d9-984d-2718b3a84137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:43.869037 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c3f3892-b27a-41d9-984d-2718b3a84137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:43.869715 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c3f3892-b27a-41d9-984d-2718b3a84137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:43.870190 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c3f3892-b27a-41d9-984d-2718b3a84137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:43.870607 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c3f3892-b27a-41d9-984d-2718b3a84137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:43.901646 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e559a42c-440f-430e-82b4-69711893d0aa tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:43.902635 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e559a42c-440f-430e-82b4-69711893d0aa tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:43.909194 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e559a42c-440f-430e-82b4-69711893d0aa tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:43.909747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e559a42c-440f-430e-82b4-69711893d0aa tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:43.910268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e559a42c-440f-430e-82b4-69711893d0aa tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:43.911022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e559a42c-440f-430e-82b4-69711893d0aa tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:43.911536 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e559a42c-440f-430e-82b4-69711893d0aa tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:43.912041 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e559a42c-440f-430e-82b4-69711893d0aa tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:43.932226 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6c3f3892-b27a-41d9-984d-2718b3a84137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:43.939831 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6c3f3892-b27a-41d9-984d-2718b3a84137 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1310 microversion: 2.1 time: 0.083235 Aug 24 11:29:43.940397 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 272/533] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:43 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:44.040663 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e559a42c-440f-430e-82b4-69711893d0aa tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:44.048387 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e559a42c-440f-430e-82b4-69711893d0aa tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.150534 Aug 24 11:29:44.048984 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 262/534] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:43 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:44.699849 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-23ab36ea-b4c2-4d75-b8ea-3782e4492465 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:44.700465 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-23ab36ea-b4c2-4d75-b8ea-3782e4492465 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:44.706471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-23ab36ea-b4c2-4d75-b8ea-3782e4492465 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:44.711330 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-23ab36ea-b4c2-4d75-b8ea-3782e4492465 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:44.711330 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-23ab36ea-b4c2-4d75-b8ea-3782e4492465 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:44.711330 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-23ab36ea-b4c2-4d75-b8ea-3782e4492465 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:44.711330 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-23ab36ea-b4c2-4d75-b8ea-3782e4492465 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:44.711669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-23ab36ea-b4c2-4d75-b8ea-3782e4492465 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:44.840056 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-23ab36ea-b4c2-4d75-b8ea-3782e4492465 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:44.849133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-23ab36ea-b4c2-4d75-b8ea-3782e4492465 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.153108 Aug 24 11:29:44.849689 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 273/535] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:44 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:44.961272 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-64e499f4-6c5c-4769-a78d-f8c6e457c2bc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:44.962516 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-64e499f4-6c5c-4769-a78d-f8c6e457c2bc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:44.968643 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64e499f4-6c5c-4769-a78d-f8c6e457c2bc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:44.969124 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64e499f4-6c5c-4769-a78d-f8c6e457c2bc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:44.969609 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64e499f4-6c5c-4769-a78d-f8c6e457c2bc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:44.970343 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64e499f4-6c5c-4769-a78d-f8c6e457c2bc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:44.970799 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64e499f4-6c5c-4769-a78d-f8c6e457c2bc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:44.971228 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64e499f4-6c5c-4769-a78d-f8c6e457c2bc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:45.036169 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-64e499f4-6c5c-4769-a78d-f8c6e457c2bc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:45.044024 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-64e499f4-6c5c-4769-a78d-f8c6e457c2bc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1310 microversion: 2.1 time: 0.087232 Aug 24 11:29:45.044610 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 263/536] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:44 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:45.068429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-945e3d2c-aebc-4fa2-8d3f-52dcea7fb3b7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:45.069039 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-945e3d2c-aebc-4fa2-8d3f-52dcea7fb3b7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:45.075465 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-945e3d2c-aebc-4fa2-8d3f-52dcea7fb3b7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:45.075948 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-945e3d2c-aebc-4fa2-8d3f-52dcea7fb3b7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:45.076388 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-945e3d2c-aebc-4fa2-8d3f-52dcea7fb3b7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:45.077080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-945e3d2c-aebc-4fa2-8d3f-52dcea7fb3b7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:45.077529 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-945e3d2c-aebc-4fa2-8d3f-52dcea7fb3b7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:45.078067 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-945e3d2c-aebc-4fa2-8d3f-52dcea7fb3b7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:45.208368 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-945e3d2c-aebc-4fa2-8d3f-52dcea7fb3b7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:45.216670 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-945e3d2c-aebc-4fa2-8d3f-52dcea7fb3b7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.151999 Aug 24 11:29:45.217167 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 274/537] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:45 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:45.870196 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-cdd615b0-14ab-463c-a2cc-58c8c22875e8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:45.870732 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-cdd615b0-14ab-463c-a2cc-58c8c22875e8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:45.876599 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cdd615b0-14ab-463c-a2cc-58c8c22875e8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:45.877078 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cdd615b0-14ab-463c-a2cc-58c8c22875e8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:45.877508 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cdd615b0-14ab-463c-a2cc-58c8c22875e8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:45.878217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cdd615b0-14ab-463c-a2cc-58c8c22875e8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:45.879306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cdd615b0-14ab-463c-a2cc-58c8c22875e8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:45.879721 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cdd615b0-14ab-463c-a2cc-58c8c22875e8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:46.008246 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-cdd615b0-14ab-463c-a2cc-58c8c22875e8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:46.016598 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-cdd615b0-14ab-463c-a2cc-58c8c22875e8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.150444 Aug 24 11:29:46.017160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 264/538] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:45 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:46.064730 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-eea1cac8-d5b4-4d58-a8ca-405c5052c088 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:46.065350 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-eea1cac8-d5b4-4d58-a8ca-405c5052c088 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:46.071382 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eea1cac8-d5b4-4d58-a8ca-405c5052c088 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:46.071970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eea1cac8-d5b4-4d58-a8ca-405c5052c088 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:46.072296 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eea1cac8-d5b4-4d58-a8ca-405c5052c088 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:46.072995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eea1cac8-d5b4-4d58-a8ca-405c5052c088 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:46.073548 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eea1cac8-d5b4-4d58-a8ca-405c5052c088 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:46.073898 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eea1cac8-d5b4-4d58-a8ca-405c5052c088 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:46.138304 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-eea1cac8-d5b4-4d58-a8ca-405c5052c088 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:46.145912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-eea1cac8-d5b4-4d58-a8ca-405c5052c088 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1310 microversion: 2.1 time: 0.085096 Aug 24 11:29:46.148917 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 275/539] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:46 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:46.239235 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e163b7ee-e9e6-4e67-a812-e496576b3b35 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:46.239894 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e163b7ee-e9e6-4e67-a812-e496576b3b35 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:46.245912 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e163b7ee-e9e6-4e67-a812-e496576b3b35 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:46.246578 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e163b7ee-e9e6-4e67-a812-e496576b3b35 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:46.247017 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e163b7ee-e9e6-4e67-a812-e496576b3b35 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:46.247710 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e163b7ee-e9e6-4e67-a812-e496576b3b35 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:46.248159 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e163b7ee-e9e6-4e67-a812-e496576b3b35 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:46.248574 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e163b7ee-e9e6-4e67-a812-e496576b3b35 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:46.377412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e163b7ee-e9e6-4e67-a812-e496576b3b35 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:46.385325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e163b7ee-e9e6-4e67-a812-e496576b3b35 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.150523 Aug 24 11:29:46.385967 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 265/540] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:46 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:47.037671 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0b5d8fc0-4891-4355-b3bc-3687fb45c884 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:47.038309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0b5d8fc0-4891-4355-b3bc-3687fb45c884 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:47.044355 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0b5d8fc0-4891-4355-b3bc-3687fb45c884 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:47.044833 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0b5d8fc0-4891-4355-b3bc-3687fb45c884 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:47.045272 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0b5d8fc0-4891-4355-b3bc-3687fb45c884 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:47.045977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0b5d8fc0-4891-4355-b3bc-3687fb45c884 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:47.046429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0b5d8fc0-4891-4355-b3bc-3687fb45c884 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:47.046844 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0b5d8fc0-4891-4355-b3bc-3687fb45c884 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:47.170545 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-89ef8631-9505-4b65-bec1-f35907789236 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:47.171236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-89ef8631-9505-4b65-bec1-f35907789236 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:47.178287 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89ef8631-9505-4b65-bec1-f35907789236 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:47.178429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0b5d8fc0-4891-4355-b3bc-3687fb45c884 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:47.179358 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89ef8631-9505-4b65-bec1-f35907789236 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:47.179969 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89ef8631-9505-4b65-bec1-f35907789236 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:47.180661 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89ef8631-9505-4b65-bec1-f35907789236 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:47.181381 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89ef8631-9505-4b65-bec1-f35907789236 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:47.181682 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89ef8631-9505-4b65-bec1-f35907789236 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:47.186900 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0b5d8fc0-4891-4355-b3bc-3687fb45c884 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.153108 Aug 24 11:29:47.187485 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 276/541] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:47 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:47.246632 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-89ef8631-9505-4b65-bec1-f35907789236 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:47.255062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-89ef8631-9505-4b65-bec1-f35907789236 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1310 microversion: 2.1 time: 0.088264 Aug 24 11:29:47.255688 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 266/542] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:47 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:47.406844 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-12e299ca-1611-48f6-9129-2111d67fdc93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:47.407459 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-12e299ca-1611-48f6-9129-2111d67fdc93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:47.413736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12e299ca-1611-48f6-9129-2111d67fdc93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:47.414268 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12e299ca-1611-48f6-9129-2111d67fdc93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:47.414704 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12e299ca-1611-48f6-9129-2111d67fdc93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:47.415443 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12e299ca-1611-48f6-9129-2111d67fdc93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:47.415905 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12e299ca-1611-48f6-9129-2111d67fdc93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:47.416357 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12e299ca-1611-48f6-9129-2111d67fdc93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:47.571858 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-12e299ca-1611-48f6-9129-2111d67fdc93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:47.587403 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-12e299ca-1611-48f6-9129-2111d67fdc93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.184415 Aug 24 11:29:47.589692 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 277/543] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:47 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:48.210571 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4f9e9052-dab6-4c83-b032-e824ab817141 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:48.211277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4f9e9052-dab6-4c83-b032-e824ab817141 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:48.217964 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4f9e9052-dab6-4c83-b032-e824ab817141 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:48.219330 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4f9e9052-dab6-4c83-b032-e824ab817141 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:48.219949 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4f9e9052-dab6-4c83-b032-e824ab817141 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:48.220666 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4f9e9052-dab6-4c83-b032-e824ab817141 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:48.221121 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4f9e9052-dab6-4c83-b032-e824ab817141 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:48.222083 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4f9e9052-dab6-4c83-b032-e824ab817141 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:48.282706 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-05bc3151-a3cb-411e-9d9e-e22e543d3e89 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:48.283973 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-05bc3151-a3cb-411e-9d9e-e22e543d3e89 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:48.293524 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05bc3151-a3cb-411e-9d9e-e22e543d3e89 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:48.294075 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05bc3151-a3cb-411e-9d9e-e22e543d3e89 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:48.294560 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05bc3151-a3cb-411e-9d9e-e22e543d3e89 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:48.295288 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05bc3151-a3cb-411e-9d9e-e22e543d3e89 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:48.295930 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05bc3151-a3cb-411e-9d9e-e22e543d3e89 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:48.297660 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05bc3151-a3cb-411e-9d9e-e22e543d3e89 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:48.303298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:48.402679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4f9e9052-dab6-4c83-b032-e824ab817141 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:48.413286 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4f9e9052-dab6-4c83-b032-e824ab817141 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.208123 Aug 24 11:29:48.414465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 267/544] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:48 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:48.606403 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-05bc3151-a3cb-411e-9d9e-e22e543d3e89 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:48.606765 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-5ca202d9-096e-42bf-bc34-debb5e59f6e5 req-fb8b1ca2-c722-41aa-98fc-47b828b5dec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f09e8c6-56b6-426a-8e2c-9d7a35fb1841", "tag": "7abd8996-69bf-4018-bb9e-c017b40dc1cd"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:29:48.615049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-05bc3151-a3cb-411e-9d9e-e22e543d3e89 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.342861 Aug 24 11:29:48.619011 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 278/545] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:48 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:48.624476 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-53af52d3-6568-49af-82c5-029a288a18e2 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:48.625385 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-53af52d3-6568-49af-82c5-029a288a18e2 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:48.633002 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53af52d3-6568-49af-82c5-029a288a18e2 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:48.633779 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53af52d3-6568-49af-82c5-029a288a18e2 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:48.635833 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53af52d3-6568-49af-82c5-029a288a18e2 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:48.636635 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-5ca202d9-096e-42bf-bc34-debb5e59f6e5 req-fb8b1ca2-c722-41aa-98fc-47b828b5dec6 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:48.636956 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53af52d3-6568-49af-82c5-029a288a18e2 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:48.637161 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-5ca202d9-096e-42bf-bc34-debb5e59f6e5 req-fb8b1ca2-c722-41aa-98fc-47b828b5dec6 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:48.637628 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-5ca202d9-096e-42bf-bc34-debb5e59f6e5 req-fb8b1ca2-c722-41aa-98fc-47b828b5dec6 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:48.637949 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53af52d3-6568-49af-82c5-029a288a18e2 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:48.638526 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53af52d3-6568-49af-82c5-029a288a18e2 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:48.651059 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-5ca202d9-096e-42bf-bc34-debb5e59f6e5 req-fb8b1ca2-c722-41aa-98fc-47b828b5dec6 service nova] Creating event network-changed:7abd8996-69bf-4018-bb9e-c017b40dc1cd for instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 on hv-cinder-85427 Aug 24 11:29:48.656900 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-5ca202d9-096e-42bf-bc34-debb5e59f6e5 req-fb8b1ca2-c722-41aa-98fc-47b828b5dec6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057638 Aug 24 11:29:48.657895 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 268/546] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:29:48.816623 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-53af52d3-6568-49af-82c5-029a288a18e2 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:48.824847 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-53af52d3-6568-49af-82c5-029a288a18e2 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.204608 Aug 24 11:29:48.825464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 279/547] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:48 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:49.438178 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=4 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:49.438902 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=14 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:49.446494 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-214141a3-edfa-400f-a996-a0b2ab3f920d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:49.466522 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-214141a3-edfa-400f-a996-a0b2ab3f920d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:49.466522 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-214141a3-edfa-400f-a996-a0b2ab3f920d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:49.466522 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-214141a3-edfa-400f-a996-a0b2ab3f920d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:49.466522 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-214141a3-edfa-400f-a996-a0b2ab3f920d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:49.467788 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-214141a3-edfa-400f-a996-a0b2ab3f920d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:49.467788 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-214141a3-edfa-400f-a996-a0b2ab3f920d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:49.467788 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-214141a3-edfa-400f-a996-a0b2ab3f920d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:49.609853 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-214141a3-edfa-400f-a996-a0b2ab3f920d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:49.625308 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-214141a3-edfa-400f-a996-a0b2ab3f920d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.182774 Aug 24 11:29:49.625308 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 269/548] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:49 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:49.650772 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8848e2aa-0521-4201-bad9-3d75285effca tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:49.651393 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8848e2aa-0521-4201-bad9-3d75285effca tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:49.653913 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=12 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:49.659376 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8848e2aa-0521-4201-bad9-3d75285effca tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:49.659899 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8848e2aa-0521-4201-bad9-3d75285effca tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:49.660335 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8848e2aa-0521-4201-bad9-3d75285effca tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:49.661032 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8848e2aa-0521-4201-bad9-3d75285effca tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:49.661483 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8848e2aa-0521-4201-bad9-3d75285effca tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:49.661923 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8848e2aa-0521-4201-bad9-3d75285effca tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:49.811730 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8848e2aa-0521-4201-bad9-3d75285effca tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:49.823018 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8848e2aa-0521-4201-bad9-3d75285effca tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.175691 Aug 24 11:29:49.826510 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 280/549] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:49 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:49.849011 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5b44a70a-1e4e-45e8-8968-3ae184e980ba tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:49.850035 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5b44a70a-1e4e-45e8-8968-3ae184e980ba tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:49.857334 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b44a70a-1e4e-45e8-8968-3ae184e980ba tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:49.857963 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b44a70a-1e4e-45e8-8968-3ae184e980ba tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:49.861470 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b44a70a-1e4e-45e8-8968-3ae184e980ba tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:49.861470 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b44a70a-1e4e-45e8-8968-3ae184e980ba tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:49.861470 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b44a70a-1e4e-45e8-8968-3ae184e980ba tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:49.861470 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b44a70a-1e4e-45e8-8968-3ae184e980ba tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:50.014048 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5b44a70a-1e4e-45e8-8968-3ae184e980ba tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:50.022856 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5b44a70a-1e4e-45e8-8968-3ae184e980ba tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.178241 Aug 24 11:29:50.037892 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 270/550] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:49 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:50.643110 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-abc76d80-e4f1-42c4-8830-94a1ffd4dbc8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:50.643823 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-abc76d80-e4f1-42c4-8830-94a1ffd4dbc8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:50.653560 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-abc76d80-e4f1-42c4-8830-94a1ffd4dbc8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:50.655018 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-abc76d80-e4f1-42c4-8830-94a1ffd4dbc8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:50.655765 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-abc76d80-e4f1-42c4-8830-94a1ffd4dbc8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:50.657847 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-abc76d80-e4f1-42c4-8830-94a1ffd4dbc8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:50.658717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-abc76d80-e4f1-42c4-8830-94a1ffd4dbc8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:50.662643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-abc76d80-e4f1-42c4-8830-94a1ffd4dbc8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:50.797819 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-abc76d80-e4f1-42c4-8830-94a1ffd4dbc8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:50.806826 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-abc76d80-e4f1-42c4-8830-94a1ffd4dbc8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.167652 Aug 24 11:29:50.807645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 281/551] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:50 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:50.844127 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d491ecbc-367a-498c-8e1f-ca600cde79f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:50.847675 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d491ecbc-367a-498c-8e1f-ca600cde79f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:50.852023 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d491ecbc-367a-498c-8e1f-ca600cde79f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:50.852508 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d491ecbc-367a-498c-8e1f-ca600cde79f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:50.852943 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d491ecbc-367a-498c-8e1f-ca600cde79f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:50.853636 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d491ecbc-367a-498c-8e1f-ca600cde79f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:50.854125 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d491ecbc-367a-498c-8e1f-ca600cde79f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:50.854550 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d491ecbc-367a-498c-8e1f-ca600cde79f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:50.990060 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d491ecbc-367a-498c-8e1f-ca600cde79f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:50.998743 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d491ecbc-367a-498c-8e1f-ca600cde79f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.158367 Aug 24 11:29:50.999992 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 271/552] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:50 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:51.045569 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fbdc790d-2d3c-43a0-889c-abadff780f52 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:51.046376 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fbdc790d-2d3c-43a0-889c-abadff780f52 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:51.053396 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fbdc790d-2d3c-43a0-889c-abadff780f52 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:51.053907 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fbdc790d-2d3c-43a0-889c-abadff780f52 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:51.054456 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fbdc790d-2d3c-43a0-889c-abadff780f52 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:51.055178 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fbdc790d-2d3c-43a0-889c-abadff780f52 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:51.055622 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fbdc790d-2d3c-43a0-889c-abadff780f52 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:51.056071 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fbdc790d-2d3c-43a0-889c-abadff780f52 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:51.182736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fbdc790d-2d3c-43a0-889c-abadff780f52 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:51.190514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fbdc790d-2d3c-43a0-889c-abadff780f52 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.149494 Aug 24 11:29:51.191699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 282/553] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:51 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:51.945211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9808c8a7-37c8-45c5-b26b-2da5e85c9f49 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:51.945833 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9808c8a7-37c8-45c5-b26b-2da5e85c9f49 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:51.952254 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9808c8a7-37c8-45c5-b26b-2da5e85c9f49 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:51.953342 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9808c8a7-37c8-45c5-b26b-2da5e85c9f49 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:51.954182 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9808c8a7-37c8-45c5-b26b-2da5e85c9f49 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:51.955063 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9808c8a7-37c8-45c5-b26b-2da5e85c9f49 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:51.955673 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9808c8a7-37c8-45c5-b26b-2da5e85c9f49 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:51.956790 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9808c8a7-37c8-45c5-b26b-2da5e85c9f49 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:52.021125 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2fbbd57d-0400-4703-b8ec-8f6a1fae5bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:52.021747 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2fbbd57d-0400-4703-b8ec-8f6a1fae5bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:52.028723 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2fbbd57d-0400-4703-b8ec-8f6a1fae5bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:52.035567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2fbbd57d-0400-4703-b8ec-8f6a1fae5bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:52.035567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2fbbd57d-0400-4703-b8ec-8f6a1fae5bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:52.035567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2fbbd57d-0400-4703-b8ec-8f6a1fae5bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:52.035567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2fbbd57d-0400-4703-b8ec-8f6a1fae5bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:52.036133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2fbbd57d-0400-4703-b8ec-8f6a1fae5bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:52.096006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9808c8a7-37c8-45c5-b26b-2da5e85c9f49 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:52.104950 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9808c8a7-37c8-45c5-b26b-2da5e85c9f49 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.280858 Aug 24 11:29:52.105539 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 272/554] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:51 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:52.179711 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2fbbd57d-0400-4703-b8ec-8f6a1fae5bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:52.188246 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2fbbd57d-0400-4703-b8ec-8f6a1fae5bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.171502 Aug 24 11:29:52.189390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 283/555] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:52 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:52.211698 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e53b7483-8faa-4375-8d43-5876650f1c51 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:52.212311 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e53b7483-8faa-4375-8d43-5876650f1c51 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:52.218466 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e53b7483-8faa-4375-8d43-5876650f1c51 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:52.218949 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e53b7483-8faa-4375-8d43-5876650f1c51 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:52.219385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e53b7483-8faa-4375-8d43-5876650f1c51 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:52.220076 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e53b7483-8faa-4375-8d43-5876650f1c51 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:52.220527 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e53b7483-8faa-4375-8d43-5876650f1c51 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:52.220948 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e53b7483-8faa-4375-8d43-5876650f1c51 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:52.353558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e53b7483-8faa-4375-8d43-5876650f1c51 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:52.361232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e53b7483-8faa-4375-8d43-5876650f1c51 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.153389 Aug 24 11:29:52.361806 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 273/556] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:52 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:53.126435 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-46dd568c-d8c2-4dac-aaa1-e43f4fc43f48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:53.127808 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-46dd568c-d8c2-4dac-aaa1-e43f4fc43f48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:53.135342 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-46dd568c-d8c2-4dac-aaa1-e43f4fc43f48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:53.135991 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-46dd568c-d8c2-4dac-aaa1-e43f4fc43f48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:53.136439 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-46dd568c-d8c2-4dac-aaa1-e43f4fc43f48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:53.137145 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-46dd568c-d8c2-4dac-aaa1-e43f4fc43f48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:53.137603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-46dd568c-d8c2-4dac-aaa1-e43f4fc43f48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:53.138063 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-46dd568c-d8c2-4dac-aaa1-e43f4fc43f48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:53.279948 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c76de495-0668-4fe1-a9b2-0e4dd783cf15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:53.281195 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c76de495-0668-4fe1-a9b2-0e4dd783cf15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:53.288597 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c76de495-0668-4fe1-a9b2-0e4dd783cf15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:53.289379 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c76de495-0668-4fe1-a9b2-0e4dd783cf15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:53.290002 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c76de495-0668-4fe1-a9b2-0e4dd783cf15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:53.291264 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c76de495-0668-4fe1-a9b2-0e4dd783cf15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:53.291873 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c76de495-0668-4fe1-a9b2-0e4dd783cf15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:53.292438 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c76de495-0668-4fe1-a9b2-0e4dd783cf15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:53.304491 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-46dd568c-d8c2-4dac-aaa1-e43f4fc43f48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:53.313653 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-46dd568c-d8c2-4dac-aaa1-e43f4fc43f48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.191488 Aug 24 11:29:53.314359 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 284/557] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:53 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:53.383680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ce1998b1-29f3-4c0e-b0c4-55811f3e8a33 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:53.384605 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ce1998b1-29f3-4c0e-b0c4-55811f3e8a33 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:53.391257 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce1998b1-29f3-4c0e-b0c4-55811f3e8a33 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:53.391867 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce1998b1-29f3-4c0e-b0c4-55811f3e8a33 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:53.392531 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce1998b1-29f3-4c0e-b0c4-55811f3e8a33 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:53.393377 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce1998b1-29f3-4c0e-b0c4-55811f3e8a33 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:53.393970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce1998b1-29f3-4c0e-b0c4-55811f3e8a33 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:53.394458 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce1998b1-29f3-4c0e-b0c4-55811f3e8a33 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:53.432400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c76de495-0668-4fe1-a9b2-0e4dd783cf15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:53.441146 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c76de495-0668-4fe1-a9b2-0e4dd783cf15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.235474 Aug 24 11:29:53.441717 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 274/558] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:53 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:53.537842 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ce1998b1-29f3-4c0e-b0c4-55811f3e8a33 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:53.545480 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ce1998b1-29f3-4c0e-b0c4-55811f3e8a33 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.165957 Aug 24 11:29:53.546121 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 285/559] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:53 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:54.336596 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-44288b2b-56eb-424a-b2f4-f1065dbac3e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:54.337242 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-44288b2b-56eb-424a-b2f4-f1065dbac3e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:54.343646 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-44288b2b-56eb-424a-b2f4-f1065dbac3e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:54.344131 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-44288b2b-56eb-424a-b2f4-f1065dbac3e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:54.344569 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-44288b2b-56eb-424a-b2f4-f1065dbac3e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:54.345261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-44288b2b-56eb-424a-b2f4-f1065dbac3e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:54.345717 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-44288b2b-56eb-424a-b2f4-f1065dbac3e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:54.346167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-44288b2b-56eb-424a-b2f4-f1065dbac3e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:54.369138 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=100 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:54.463985 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e1f0762f-19d6-48e7-8d74-379a175ced12 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:54.490310 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e1f0762f-19d6-48e7-8d74-379a175ced12 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:54.490310 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1f0762f-19d6-48e7-8d74-379a175ced12 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:54.490310 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1f0762f-19d6-48e7-8d74-379a175ced12 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:54.490310 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1f0762f-19d6-48e7-8d74-379a175ced12 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:54.490894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1f0762f-19d6-48e7-8d74-379a175ced12 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:54.490894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1f0762f-19d6-48e7-8d74-379a175ced12 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:54.490894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1f0762f-19d6-48e7-8d74-379a175ced12 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:54.494468 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-44288b2b-56eb-424a-b2f4-f1065dbac3e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:54.503154 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-44288b2b-56eb-424a-b2f4-f1065dbac3e3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.170274 Aug 24 11:29:54.504220 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 275/560] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:54 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:54.567304 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-317ec13c-ac09-4757-b3eb-bcb639d0e317 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:54.568002 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-317ec13c-ac09-4757-b3eb-bcb639d0e317 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:54.575577 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-317ec13c-ac09-4757-b3eb-bcb639d0e317 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:54.576228 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-317ec13c-ac09-4757-b3eb-bcb639d0e317 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:54.577820 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-317ec13c-ac09-4757-b3eb-bcb639d0e317 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:54.577820 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-317ec13c-ac09-4757-b3eb-bcb639d0e317 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:54.578086 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-317ec13c-ac09-4757-b3eb-bcb639d0e317 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:54.578618 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-317ec13c-ac09-4757-b3eb-bcb639d0e317 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:54.655145 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e1f0762f-19d6-48e7-8d74-379a175ced12 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:54.665303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e1f0762f-19d6-48e7-8d74-379a175ced12 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.205437 Aug 24 11:29:54.674878 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 286/561] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:54 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:54.721082 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-317ec13c-ac09-4757-b3eb-bcb639d0e317 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:54.729345 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-317ec13c-ac09-4757-b3eb-bcb639d0e317 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.166331 Aug 24 11:29:54.729921 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 276/562] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:54 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:54.975220 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:29:54.975805 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:29:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:29:55.525742 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f0175ed7-2d0e-4943-822d-5147c30f592c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:55.526763 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f0175ed7-2d0e-4943-822d-5147c30f592c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:55.535006 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0175ed7-2d0e-4943-822d-5147c30f592c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:55.535500 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0175ed7-2d0e-4943-822d-5147c30f592c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:55.535940 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0175ed7-2d0e-4943-822d-5147c30f592c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:55.536644 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0175ed7-2d0e-4943-822d-5147c30f592c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:55.537101 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0175ed7-2d0e-4943-822d-5147c30f592c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:55.537527 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0175ed7-2d0e-4943-822d-5147c30f592c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:55.688560 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f0175ed7-2d0e-4943-822d-5147c30f592c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:55.691588 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d5220ca1-3110-4a5b-9440-d96bd46207de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:55.692392 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d5220ca1-3110-4a5b-9440-d96bd46207de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:55.704205 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f0175ed7-2d0e-4943-822d-5147c30f592c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.183387 Aug 24 11:29:55.704786 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 287/563] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:55 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:55.712459 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d5220ca1-3110-4a5b-9440-d96bd46207de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:55.713510 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d5220ca1-3110-4a5b-9440-d96bd46207de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:55.714109 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d5220ca1-3110-4a5b-9440-d96bd46207de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:55.714911 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d5220ca1-3110-4a5b-9440-d96bd46207de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:55.715478 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d5220ca1-3110-4a5b-9440-d96bd46207de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:55.716148 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d5220ca1-3110-4a5b-9440-d96bd46207de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:55.749801 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0f25e11d-9483-4c67-8d46-70527e8c0b57 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:55.755126 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0f25e11d-9483-4c67-8d46-70527e8c0b57 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:55.764486 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0f25e11d-9483-4c67-8d46-70527e8c0b57 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:55.765362 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0f25e11d-9483-4c67-8d46-70527e8c0b57 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:55.765861 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0f25e11d-9483-4c67-8d46-70527e8c0b57 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:55.766935 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0f25e11d-9483-4c67-8d46-70527e8c0b57 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:55.767754 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0f25e11d-9483-4c67-8d46-70527e8c0b57 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:55.768366 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0f25e11d-9483-4c67-8d46-70527e8c0b57 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:55.875000 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d5220ca1-3110-4a5b-9440-d96bd46207de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:55.875821 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d5220ca1-3110-4a5b-9440-d96bd46207de tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.192854 Aug 24 11:29:55.876440 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 277/564] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:55 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:55.927907 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0f25e11d-9483-4c67-8d46-70527e8c0b57 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:55.936143 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0f25e11d-9483-4c67-8d46-70527e8c0b57 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.190142 Aug 24 11:29:55.936790 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 288/565] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:55 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:56.726056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ba6e13ee-2dde-442c-9bed-076a0dcbb69e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:56.726685 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ba6e13ee-2dde-442c-9bed-076a0dcbb69e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:56.733592 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba6e13ee-2dde-442c-9bed-076a0dcbb69e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:56.734125 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba6e13ee-2dde-442c-9bed-076a0dcbb69e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:56.734562 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba6e13ee-2dde-442c-9bed-076a0dcbb69e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:56.735271 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba6e13ee-2dde-442c-9bed-076a0dcbb69e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:56.735737 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba6e13ee-2dde-442c-9bed-076a0dcbb69e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:56.736160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba6e13ee-2dde-442c-9bed-076a0dcbb69e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:56.880005 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ba6e13ee-2dde-442c-9bed-076a0dcbb69e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:56.888826 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ba6e13ee-2dde-442c-9bed-076a0dcbb69e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.166759 Aug 24 11:29:56.889396 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 278/566] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:56 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:56.897147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5d8138a6-ed27-41e1-bba4-47a0044b6663 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:56.897759 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5d8138a6-ed27-41e1-bba4-47a0044b6663 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:56.904449 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d8138a6-ed27-41e1-bba4-47a0044b6663 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:56.904995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d8138a6-ed27-41e1-bba4-47a0044b6663 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:56.905424 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d8138a6-ed27-41e1-bba4-47a0044b6663 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:56.906133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d8138a6-ed27-41e1-bba4-47a0044b6663 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:56.906580 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d8138a6-ed27-41e1-bba4-47a0044b6663 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:56.906995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d8138a6-ed27-41e1-bba4-47a0044b6663 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:56.956760 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-53be2131-dc96-445e-b72e-2fe068dbbfa6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:56.957379 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-53be2131-dc96-445e-b72e-2fe068dbbfa6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:56.963856 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-53be2131-dc96-445e-b72e-2fe068dbbfa6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:56.964307 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-53be2131-dc96-445e-b72e-2fe068dbbfa6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:56.964750 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-53be2131-dc96-445e-b72e-2fe068dbbfa6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:56.965456 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-53be2131-dc96-445e-b72e-2fe068dbbfa6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:56.966089 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-53be2131-dc96-445e-b72e-2fe068dbbfa6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:56.966519 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-53be2131-dc96-445e-b72e-2fe068dbbfa6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:57.058296 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5d8138a6-ed27-41e1-bba4-47a0044b6663 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:57.067426 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5d8138a6-ed27-41e1-bba4-47a0044b6663 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.174712 Aug 24 11:29:57.068031 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 289/567] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:56 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:57.122311 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-53be2131-dc96-445e-b72e-2fe068dbbfa6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:57.130772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-53be2131-dc96-445e-b72e-2fe068dbbfa6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.177941 Aug 24 11:29:57.131278 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 279/568] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:56 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:57.911244 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9d52ddd3-c058-4997-bc43-a5db49ccd997 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:57.911854 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9d52ddd3-c058-4997-bc43-a5db49ccd997 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:57.914249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:57.918920 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d52ddd3-c058-4997-bc43-a5db49ccd997 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:57.919410 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d52ddd3-c058-4997-bc43-a5db49ccd997 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:57.919853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d52ddd3-c058-4997-bc43-a5db49ccd997 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:57.920539 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d52ddd3-c058-4997-bc43-a5db49ccd997 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:57.920997 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d52ddd3-c058-4997-bc43-a5db49ccd997 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:57.921426 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d52ddd3-c058-4997-bc43-a5db49ccd997 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:58.066773 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9d52ddd3-c058-4997-bc43-a5db49ccd997 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:58.075247 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9d52ddd3-c058-4997-bc43-a5db49ccd997 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.168435 Aug 24 11:29:58.075826 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 290/569] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:57 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:58.088569 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f4df6a2a-c6d0-4aac-b437-f703f0f54d81 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:58.090382 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f4df6a2a-c6d0-4aac-b437-f703f0f54d81 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:58.096596 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f4df6a2a-c6d0-4aac-b437-f703f0f54d81 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:58.097097 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f4df6a2a-c6d0-4aac-b437-f703f0f54d81 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:58.097536 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f4df6a2a-c6d0-4aac-b437-f703f0f54d81 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:58.098277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f4df6a2a-c6d0-4aac-b437-f703f0f54d81 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:58.098735 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f4df6a2a-c6d0-4aac-b437-f703f0f54d81 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:58.099161 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f4df6a2a-c6d0-4aac-b437-f703f0f54d81 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:58.152884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f37b2468-a129-4e58-afeb-393b061697fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:58.153833 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f37b2468-a129-4e58-afeb-393b061697fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:58.162701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f37b2468-a129-4e58-afeb-393b061697fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:58.163557 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f37b2468-a129-4e58-afeb-393b061697fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:58.164229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f37b2468-a129-4e58-afeb-393b061697fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:58.166220 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f37b2468-a129-4e58-afeb-393b061697fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:58.166972 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f37b2468-a129-4e58-afeb-393b061697fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:58.167663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f37b2468-a129-4e58-afeb-393b061697fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:58.254076 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f4df6a2a-c6d0-4aac-b437-f703f0f54d81 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:58.262157 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f4df6a2a-c6d0-4aac-b437-f703f0f54d81 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.177278 Aug 24 11:29:58.264793 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 280/570] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:58 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:58.304825 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f37b2468-a129-4e58-afeb-393b061697fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:58.312938 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f37b2468-a129-4e58-afeb-393b061697fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.164281 Aug 24 11:29:58.313511 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 291/571] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:58 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:29:59.097815 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3fd284a4-fea4-493f-a7be-3d82a184fdf0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:59.098517 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3fd284a4-fea4-493f-a7be-3d82a184fdf0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:59.105140 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fd284a4-fea4-493f-a7be-3d82a184fdf0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:59.105625 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fd284a4-fea4-493f-a7be-3d82a184fdf0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:59.106095 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fd284a4-fea4-493f-a7be-3d82a184fdf0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:59.106793 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fd284a4-fea4-493f-a7be-3d82a184fdf0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:59.107249 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fd284a4-fea4-493f-a7be-3d82a184fdf0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:59.107674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fd284a4-fea4-493f-a7be-3d82a184fdf0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:59.245746 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3fd284a4-fea4-493f-a7be-3d82a184fdf0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:59.254651 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3fd284a4-fea4-493f-a7be-3d82a184fdf0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.161227 Aug 24 11:29:59.255216 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 281/572] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:59 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:59.283145 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-30907820-0985-48dc-a75d-8081fbba2c8c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:59.283780 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-30907820-0985-48dc-a75d-8081fbba2c8c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:59.290015 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-30907820-0985-48dc-a75d-8081fbba2c8c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:59.290533 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-30907820-0985-48dc-a75d-8081fbba2c8c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:59.290973 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-30907820-0985-48dc-a75d-8081fbba2c8c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:59.291673 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-30907820-0985-48dc-a75d-8081fbba2c8c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:59.292124 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-30907820-0985-48dc-a75d-8081fbba2c8c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:59.292545 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-30907820-0985-48dc-a75d-8081fbba2c8c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:59.334396 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6b8f221f-2e30-450e-aa64-6438f59646d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:29:59.335114 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6b8f221f-2e30-450e-aa64-6438f59646d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:29:59.337099 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:29:59.345534 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b8f221f-2e30-450e-aa64-6438f59646d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:59.353747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b8f221f-2e30-450e-aa64-6438f59646d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:59.353747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b8f221f-2e30-450e-aa64-6438f59646d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:59.353747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b8f221f-2e30-450e-aa64-6438f59646d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:29:59.353747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b8f221f-2e30-450e-aa64-6438f59646d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:29:59.354269 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6b8f221f-2e30-450e-aa64-6438f59646d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:29:59.433736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-30907820-0985-48dc-a75d-8081fbba2c8c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:59.448881 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-30907820-0985-48dc-a75d-8081fbba2c8c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.169087 Aug 24 11:29:59.460346 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 292/573] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:59 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:29:59.525212 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6b8f221f-2e30-450e-aa64-6438f59646d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:29:59.533093 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6b8f221f-2e30-450e-aa64-6438f59646d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.202652 Aug 24 11:29:59.533654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 282/574] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:29:59 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:00.278661 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9d3d3554-8db6-435d-9201-db1ff3a8ee70 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:00.279447 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9d3d3554-8db6-435d-9201-db1ff3a8ee70 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:00.286810 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d3d3554-8db6-435d-9201-db1ff3a8ee70 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:00.287561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d3d3554-8db6-435d-9201-db1ff3a8ee70 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:00.287870 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d3d3554-8db6-435d-9201-db1ff3a8ee70 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:00.288577 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d3d3554-8db6-435d-9201-db1ff3a8ee70 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:00.289032 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d3d3554-8db6-435d-9201-db1ff3a8ee70 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:00.289604 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d3d3554-8db6-435d-9201-db1ff3a8ee70 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:00.439966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9d3d3554-8db6-435d-9201-db1ff3a8ee70 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:00.448888 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9d3d3554-8db6-435d-9201-db1ff3a8ee70 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.174511 Aug 24 11:30:00.454605 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 293/575] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:00 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:00.469096 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7a272da2-46bf-429e-b32c-1cb9b4089f2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:00.469770 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7a272da2-46bf-429e-b32c-1cb9b4089f2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:00.476287 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7a272da2-46bf-429e-b32c-1cb9b4089f2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:00.476774 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7a272da2-46bf-429e-b32c-1cb9b4089f2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:00.477209 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7a272da2-46bf-429e-b32c-1cb9b4089f2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:00.477912 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7a272da2-46bf-429e-b32c-1cb9b4089f2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:00.478373 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7a272da2-46bf-429e-b32c-1cb9b4089f2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:00.478794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7a272da2-46bf-429e-b32c-1cb9b4089f2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:00.554394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3cc286c9-d35b-44c2-8b94-9c8879e94893 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:00.555138 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3cc286c9-d35b-44c2-8b94-9c8879e94893 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:00.561067 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3cc286c9-d35b-44c2-8b94-9c8879e94893 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:00.561546 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3cc286c9-d35b-44c2-8b94-9c8879e94893 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:00.562011 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3cc286c9-d35b-44c2-8b94-9c8879e94893 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:00.562703 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3cc286c9-d35b-44c2-8b94-9c8879e94893 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:00.563148 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3cc286c9-d35b-44c2-8b94-9c8879e94893 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:00.563567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3cc286c9-d35b-44c2-8b94-9c8879e94893 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:00.638356 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7a272da2-46bf-429e-b32c-1cb9b4089f2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:00.647788 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7a272da2-46bf-429e-b32c-1cb9b4089f2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.182367 Aug 24 11:30:00.648400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 283/576] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:00 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:00.719125 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3cc286c9-d35b-44c2-8b94-9c8879e94893 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:00.721499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:00.726235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3cc286c9-d35b-44c2-8b94-9c8879e94893 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.175629 Aug 24 11:30:00.731592 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 294/577] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:00 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:01.471001 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-30a0ec4c-93c1-4117-be04-1c7cb992bffb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:01.471640 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-30a0ec4c-93c1-4117-be04-1c7cb992bffb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:01.478792 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-30a0ec4c-93c1-4117-be04-1c7cb992bffb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:01.479276 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-30a0ec4c-93c1-4117-be04-1c7cb992bffb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:01.479747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-30a0ec4c-93c1-4117-be04-1c7cb992bffb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:01.480440 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-30a0ec4c-93c1-4117-be04-1c7cb992bffb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:01.480893 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-30a0ec4c-93c1-4117-be04-1c7cb992bffb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:01.481313 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-30a0ec4c-93c1-4117-be04-1c7cb992bffb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:01.615280 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-30a0ec4c-93c1-4117-be04-1c7cb992bffb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:01.623836 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-30a0ec4c-93c1-4117-be04-1c7cb992bffb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.156671 Aug 24 11:30:01.624422 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 284/578] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:01 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:01.668900 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f84bc7ea-d059-49a5-91e2-474652f2f4dd tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:01.669493 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f84bc7ea-d059-49a5-91e2-474652f2f4dd tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:01.676314 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f84bc7ea-d059-49a5-91e2-474652f2f4dd tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:01.676802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f84bc7ea-d059-49a5-91e2-474652f2f4dd tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:01.677239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f84bc7ea-d059-49a5-91e2-474652f2f4dd tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:01.678047 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f84bc7ea-d059-49a5-91e2-474652f2f4dd tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:01.678697 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f84bc7ea-d059-49a5-91e2-474652f2f4dd tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:01.679159 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f84bc7ea-d059-49a5-91e2-474652f2f4dd tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:01.748855 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-13936006-faf0-4a3b-98b4-823bc5afc687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:01.749374 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-13936006-faf0-4a3b-98b4-823bc5afc687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:01.755749 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-13936006-faf0-4a3b-98b4-823bc5afc687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:01.756229 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-13936006-faf0-4a3b-98b4-823bc5afc687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:01.756664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-13936006-faf0-4a3b-98b4-823bc5afc687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:01.757350 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-13936006-faf0-4a3b-98b4-823bc5afc687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:01.757793 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-13936006-faf0-4a3b-98b4-823bc5afc687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:01.758233 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-13936006-faf0-4a3b-98b4-823bc5afc687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:01.817643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f84bc7ea-d059-49a5-91e2-474652f2f4dd tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:01.826603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f84bc7ea-d059-49a5-91e2-474652f2f4dd tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.161850 Aug 24 11:30:01.828323 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 295/579] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:01 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:01.887346 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-13936006-faf0-4a3b-98b4-823bc5afc687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:01.896082 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-13936006-faf0-4a3b-98b4-823bc5afc687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.151296 Aug 24 11:30:01.896647 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 285/580] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:01 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:02.645653 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a0fc7117-9e3b-4940-8875-97e3fbb3069a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:02.646259 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a0fc7117-9e3b-4940-8875-97e3fbb3069a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:02.652520 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0fc7117-9e3b-4940-8875-97e3fbb3069a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:02.653005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0fc7117-9e3b-4940-8875-97e3fbb3069a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:02.653429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0fc7117-9e3b-4940-8875-97e3fbb3069a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:02.654149 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0fc7117-9e3b-4940-8875-97e3fbb3069a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:02.654597 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0fc7117-9e3b-4940-8875-97e3fbb3069a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:02.655012 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0fc7117-9e3b-4940-8875-97e3fbb3069a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:02.786950 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a0fc7117-9e3b-4940-8875-97e3fbb3069a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:02.795248 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a0fc7117-9e3b-4940-8875-97e3fbb3069a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.154242 Aug 24 11:30:02.799503 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 296/581] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:02 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:02.848195 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9fdcef37-67dc-47ce-b0de-3d812197d20a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:02.848849 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9fdcef37-67dc-47ce-b0de-3d812197d20a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:02.855410 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fdcef37-67dc-47ce-b0de-3d812197d20a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:02.855941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fdcef37-67dc-47ce-b0de-3d812197d20a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:02.856399 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fdcef37-67dc-47ce-b0de-3d812197d20a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:02.857123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fdcef37-67dc-47ce-b0de-3d812197d20a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:02.857625 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fdcef37-67dc-47ce-b0de-3d812197d20a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:02.858073 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fdcef37-67dc-47ce-b0de-3d812197d20a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:02.916927 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5ff7a5d7-ff5f-4bdd-a1c3-2ce134853261 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:02.917488 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5ff7a5d7-ff5f-4bdd-a1c3-2ce134853261 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:02.923617 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ff7a5d7-ff5f-4bdd-a1c3-2ce134853261 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:02.924103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ff7a5d7-ff5f-4bdd-a1c3-2ce134853261 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:02.924542 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ff7a5d7-ff5f-4bdd-a1c3-2ce134853261 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:02.925236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ff7a5d7-ff5f-4bdd-a1c3-2ce134853261 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:02.925756 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ff7a5d7-ff5f-4bdd-a1c3-2ce134853261 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:02.926221 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ff7a5d7-ff5f-4bdd-a1c3-2ce134853261 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:02.990431 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9fdcef37-67dc-47ce-b0de-3d812197d20a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:02.998198 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9fdcef37-67dc-47ce-b0de-3d812197d20a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.153797 Aug 24 11:30:02.998781 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 286/582] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:02 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:03.055703 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5ff7a5d7-ff5f-4bdd-a1c3-2ce134853261 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:03.063315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5ff7a5d7-ff5f-4bdd-a1c3-2ce134853261 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.150612 Aug 24 11:30:03.063872 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 297/583] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:02 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:03.816491 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-decdbc2c-ba9c-4cd9-86eb-2e78b0fc3367 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:03.817103 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-decdbc2c-ba9c-4cd9-86eb-2e78b0fc3367 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:03.823151 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-decdbc2c-ba9c-4cd9-86eb-2e78b0fc3367 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:03.823618 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-decdbc2c-ba9c-4cd9-86eb-2e78b0fc3367 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:03.824057 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-decdbc2c-ba9c-4cd9-86eb-2e78b0fc3367 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:03.824748 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-decdbc2c-ba9c-4cd9-86eb-2e78b0fc3367 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:03.825203 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-decdbc2c-ba9c-4cd9-86eb-2e78b0fc3367 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:03.825627 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-decdbc2c-ba9c-4cd9-86eb-2e78b0fc3367 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:03.957337 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-decdbc2c-ba9c-4cd9-86eb-2e78b0fc3367 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:03.966229 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-decdbc2c-ba9c-4cd9-86eb-2e78b0fc3367 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.153506 Aug 24 11:30:03.966802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 287/584] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:03 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:04.018945 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-eeecbbca-0c05-426b-bbb4-f690fc175cdc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:04.019563 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-eeecbbca-0c05-426b-bbb4-f690fc175cdc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:04.026312 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eeecbbca-0c05-426b-bbb4-f690fc175cdc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:04.026798 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eeecbbca-0c05-426b-bbb4-f690fc175cdc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:04.027236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eeecbbca-0c05-426b-bbb4-f690fc175cdc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:04.027935 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eeecbbca-0c05-426b-bbb4-f690fc175cdc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:04.028390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eeecbbca-0c05-426b-bbb4-f690fc175cdc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:04.028812 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eeecbbca-0c05-426b-bbb4-f690fc175cdc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:04.083802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-06430dbe-0e58-4056-8744-2e314e493124 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:04.084317 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-06430dbe-0e58-4056-8744-2e314e493124 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:04.090216 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-06430dbe-0e58-4056-8744-2e314e493124 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:04.090691 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-06430dbe-0e58-4056-8744-2e314e493124 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:04.091120 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-06430dbe-0e58-4056-8744-2e314e493124 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:04.091802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-06430dbe-0e58-4056-8744-2e314e493124 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:04.092243 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-06430dbe-0e58-4056-8744-2e314e493124 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:04.092655 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-06430dbe-0e58-4056-8744-2e314e493124 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:04.160684 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-eeecbbca-0c05-426b-bbb4-f690fc175cdc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:04.168888 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-eeecbbca-0c05-426b-bbb4-f690fc175cdc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.153715 Aug 24 11:30:04.169459 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 298/585] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:04 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:04.224224 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-06430dbe-0e58-4056-8744-2e314e493124 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:04.231870 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-06430dbe-0e58-4056-8744-2e314e493124 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.152050 Aug 24 11:30:04.232433 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 288/586] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:04 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:04.988147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9fac22ec-8d0c-4c54-b4b1-ed877c030389 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:04.996262 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9fac22ec-8d0c-4c54-b4b1-ed877c030389 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:05.007059 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9fac22ec-8d0c-4c54-b4b1-ed877c030389 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.007562 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9fac22ec-8d0c-4c54-b4b1-ed877c030389 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.007999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9fac22ec-8d0c-4c54-b4b1-ed877c030389 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.008707 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9fac22ec-8d0c-4c54-b4b1-ed877c030389 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.009217 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9fac22ec-8d0c-4c54-b4b1-ed877c030389 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.009647 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9fac22ec-8d0c-4c54-b4b1-ed877c030389 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.191695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4c3b247e-3789-4926-a168-92e7f64122d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:05.194767 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4c3b247e-3789-4926-a168-92e7f64122d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:05.201097 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4c3b247e-3789-4926-a168-92e7f64122d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.201583 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4c3b247e-3789-4926-a168-92e7f64122d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.202038 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4c3b247e-3789-4926-a168-92e7f64122d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.202732 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4c3b247e-3789-4926-a168-92e7f64122d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.203184 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4c3b247e-3789-4926-a168-92e7f64122d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.203594 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4c3b247e-3789-4926-a168-92e7f64122d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.343155 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9fac22ec-8d0c-4c54-b4b1-ed877c030389 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:05.360483 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9fac22ec-8d0c-4c54-b4b1-ed877c030389 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.376413 Aug 24 11:30:05.367983 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 299/587] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:04 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:05.380612 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-60ae8730-310c-4313-8bee-da11addead8f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:05.382064 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-60ae8730-310c-4313-8bee-da11addead8f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:05.389737 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60ae8730-310c-4313-8bee-da11addead8f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.390503 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60ae8730-310c-4313-8bee-da11addead8f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.391320 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60ae8730-310c-4313-8bee-da11addead8f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.392289 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60ae8730-310c-4313-8bee-da11addead8f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:05.392979 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60ae8730-310c-4313-8bee-da11addead8f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:05.394137 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60ae8730-310c-4313-8bee-da11addead8f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:05.772702 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4c3b247e-3789-4926-a168-92e7f64122d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:05.802686 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4c3b247e-3789-4926-a168-92e7f64122d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.595466 Aug 24 11:30:05.802686 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 289/588] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:05 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:05.914429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-60ae8730-310c-4313-8bee-da11addead8f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:05.922998 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-60ae8730-310c-4313-8bee-da11addead8f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.553242 Aug 24 11:30:05.923927 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 300/589] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:05 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:06.382489 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0b22423d-a76a-41ad-be8a-2313a6b1ac65 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:06.383129 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0b22423d-a76a-41ad-be8a-2313a6b1ac65 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:06.390580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0b22423d-a76a-41ad-be8a-2313a6b1ac65 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:06.391066 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0b22423d-a76a-41ad-be8a-2313a6b1ac65 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:06.391498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0b22423d-a76a-41ad-be8a-2313a6b1ac65 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:06.392192 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0b22423d-a76a-41ad-be8a-2313a6b1ac65 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:06.392639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0b22423d-a76a-41ad-be8a-2313a6b1ac65 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:06.393053 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0b22423d-a76a-41ad-be8a-2313a6b1ac65 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:06.626248 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0b22423d-a76a-41ad-be8a-2313a6b1ac65 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:06.635619 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0b22423d-a76a-41ad-be8a-2313a6b1ac65 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1705 microversion: 2.1 time: 0.256938 Aug 24 11:30:06.636818 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 290/590] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:06 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1705 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:06.748140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-6e8694ed-26a4-41a3-9b77-3050816b5ec9 req-7b392e3f-0361-435d-a540-09e39a27bee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52c2009e-3a3a-4e95-a967-0275cb1fe2b7", "tag": "bfbbb09f-cfde-48f3-8c4e-dff38fe58e8d"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:06.760047 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-6e8694ed-26a4-41a3-9b77-3050816b5ec9 req-7b392e3f-0361-435d-a540-09e39a27bee1 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:06.760513 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-6e8694ed-26a4-41a3-9b77-3050816b5ec9 req-7b392e3f-0361-435d-a540-09e39a27bee1 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:06.760939 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-6e8694ed-26a4-41a3-9b77-3050816b5ec9 req-7b392e3f-0361-435d-a540-09e39a27bee1 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:06.774211 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-6e8694ed-26a4-41a3-9b77-3050816b5ec9 req-7b392e3f-0361-435d-a540-09e39a27bee1 service nova] Creating event network-changed:bfbbb09f-cfde-48f3-8c4e-dff38fe58e8d for instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 on hv-cinder-85427 Aug 24 11:30:06.779711 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-6e8694ed-26a4-41a3-9b77-3050816b5ec9 req-7b392e3f-0361-435d-a540-09e39a27bee1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035263 Aug 24 11:30:06.780335 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 301/591] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:06.808648 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b7072923-6b94-4cd7-81c1-6a4ce789b4c9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:06.809261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b7072923-6b94-4cd7-81c1-6a4ce789b4c9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:06.815465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b7072923-6b94-4cd7-81c1-6a4ce789b4c9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:06.816443 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b7072923-6b94-4cd7-81c1-6a4ce789b4c9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:06.816443 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b7072923-6b94-4cd7-81c1-6a4ce789b4c9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:06.817782 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b7072923-6b94-4cd7-81c1-6a4ce789b4c9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:06.818266 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b7072923-6b94-4cd7-81c1-6a4ce789b4c9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:06.818692 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b7072923-6b94-4cd7-81c1-6a4ce789b4c9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:06.944786 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f268df6b-0a06-461a-ab9a-9d1f36fbbde3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:06.945506 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f268df6b-0a06-461a-ab9a-9d1f36fbbde3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:06.952110 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f268df6b-0a06-461a-ab9a-9d1f36fbbde3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:06.952603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f268df6b-0a06-461a-ab9a-9d1f36fbbde3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:06.953035 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f268df6b-0a06-461a-ab9a-9d1f36fbbde3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:06.953971 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f268df6b-0a06-461a-ab9a-9d1f36fbbde3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:06.958572 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b7072923-6b94-4cd7-81c1-6a4ce789b4c9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:06.962051 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f268df6b-0a06-461a-ab9a-9d1f36fbbde3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:06.962591 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f268df6b-0a06-461a-ab9a-9d1f36fbbde3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:06.970320 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b7072923-6b94-4cd7-81c1-6a4ce789b4c9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.165485 Aug 24 11:30:06.970912 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 291/592] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:06 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:07.101089 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f268df6b-0a06-461a-ab9a-9d1f36fbbde3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:07.109096 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f268df6b-0a06-461a-ab9a-9d1f36fbbde3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.169040 Aug 24 11:30:07.109695 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 302/593] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:06 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:07.658058 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a0ca4e0f-d4ed-4275-8257-e5ffd34626f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:07.658601 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a0ca4e0f-d4ed-4275-8257-e5ffd34626f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:07.665444 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a0ca4e0f-d4ed-4275-8257-e5ffd34626f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:07.665975 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a0ca4e0f-d4ed-4275-8257-e5ffd34626f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:07.666417 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a0ca4e0f-d4ed-4275-8257-e5ffd34626f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:07.667104 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a0ca4e0f-d4ed-4275-8257-e5ffd34626f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:07.667565 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a0ca4e0f-d4ed-4275-8257-e5ffd34626f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:07.667990 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a0ca4e0f-d4ed-4275-8257-e5ffd34626f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:07.672035 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=100 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:07.803123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a0ca4e0f-d4ed-4275-8257-e5ffd34626f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:07.811317 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a0ca4e0f-d4ed-4275-8257-e5ffd34626f6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1709 microversion: 2.1 time: 0.157282 Aug 24 11:30:07.811875 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 292/594] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:07 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:07.992916 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e48400a7-17b1-4d3c-b3e2-dbbd28e025d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:07.993469 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e48400a7-17b1-4d3c-b3e2-dbbd28e025d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:07.999941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e48400a7-17b1-4d3c-b3e2-dbbd28e025d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:08.000422 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e48400a7-17b1-4d3c-b3e2-dbbd28e025d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:08.000854 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e48400a7-17b1-4d3c-b3e2-dbbd28e025d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:08.001542 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e48400a7-17b1-4d3c-b3e2-dbbd28e025d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:08.002021 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e48400a7-17b1-4d3c-b3e2-dbbd28e025d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:08.002442 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e48400a7-17b1-4d3c-b3e2-dbbd28e025d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:08.130165 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e48400a7-17b1-4d3c-b3e2-dbbd28e025d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:08.130598 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8ba3195d-1a26-4627-8702-05cf82457532 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:08.131284 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8ba3195d-1a26-4627-8702-05cf82457532 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:08.137229 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ba3195d-1a26-4627-8702-05cf82457532 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:08.137718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ba3195d-1a26-4627-8702-05cf82457532 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:08.137913 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e48400a7-17b1-4d3c-b3e2-dbbd28e025d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.149693 Aug 24 11:30:08.138189 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ba3195d-1a26-4627-8702-05cf82457532 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:08.138491 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 303/595] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:07 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:08.138891 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ba3195d-1a26-4627-8702-05cf82457532 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:08.139356 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ba3195d-1a26-4627-8702-05cf82457532 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:08.139773 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ba3195d-1a26-4627-8702-05cf82457532 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:08.277390 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8ba3195d-1a26-4627-8702-05cf82457532 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:08.285113 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8ba3195d-1a26-4627-8702-05cf82457532 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.158371 Aug 24 11:30:08.286538 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 293/596] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:08 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:09.159191 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7ba78ac7-849f-453c-8ad7-25ecec4b0a7e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:09.159857 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7ba78ac7-849f-453c-8ad7-25ecec4b0a7e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:09.166325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ba78ac7-849f-453c-8ad7-25ecec4b0a7e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:09.166800 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ba78ac7-849f-453c-8ad7-25ecec4b0a7e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:09.167231 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ba78ac7-849f-453c-8ad7-25ecec4b0a7e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:09.167913 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ba78ac7-849f-453c-8ad7-25ecec4b0a7e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:09.168356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ba78ac7-849f-453c-8ad7-25ecec4b0a7e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:09.168778 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ba78ac7-849f-453c-8ad7-25ecec4b0a7e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:09.303741 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7ba78ac7-849f-453c-8ad7-25ecec4b0a7e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:09.306677 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d3bcf999-3fac-4f9c-88ca-f270c5dacc4a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:09.307293 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d3bcf999-3fac-4f9c-88ca-f270c5dacc4a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:09.311649 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7ba78ac7-849f-453c-8ad7-25ecec4b0a7e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.156260 Aug 24 11:30:09.312220 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 304/597] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:09 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:09.313922 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d3bcf999-3fac-4f9c-88ca-f270c5dacc4a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:09.314409 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d3bcf999-3fac-4f9c-88ca-f270c5dacc4a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:09.314852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d3bcf999-3fac-4f9c-88ca-f270c5dacc4a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:09.315544 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d3bcf999-3fac-4f9c-88ca-f270c5dacc4a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:09.315992 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d3bcf999-3fac-4f9c-88ca-f270c5dacc4a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:09.316412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d3bcf999-3fac-4f9c-88ca-f270c5dacc4a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:09.454528 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d3bcf999-3fac-4f9c-88ca-f270c5dacc4a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:09.462819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d3bcf999-3fac-4f9c-88ca-f270c5dacc4a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.159908 Aug 24 11:30:09.463399 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 294/598] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:09 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:10.333175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-df391964-0e03-4139-98c4-40648fa5e2ec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:10.333860 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-df391964-0e03-4139-98c4-40648fa5e2ec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:10.340247 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-df391964-0e03-4139-98c4-40648fa5e2ec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:10.340732 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-df391964-0e03-4139-98c4-40648fa5e2ec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:10.341165 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-df391964-0e03-4139-98c4-40648fa5e2ec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:10.341851 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-df391964-0e03-4139-98c4-40648fa5e2ec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:10.342334 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-df391964-0e03-4139-98c4-40648fa5e2ec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:10.347709 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-df391964-0e03-4139-98c4-40648fa5e2ec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:10.478842 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-df391964-0e03-4139-98c4-40648fa5e2ec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:10.484206 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ba2f8c03-2dde-4f7e-a43a-a03882d510fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:10.484927 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ba2f8c03-2dde-4f7e-a43a-a03882d510fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:10.487042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-df391964-0e03-4139-98c4-40648fa5e2ec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.158144 Aug 24 11:30:10.487624 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 305/599] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:10 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:10.492098 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba2f8c03-2dde-4f7e-a43a-a03882d510fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:10.492655 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba2f8c03-2dde-4f7e-a43a-a03882d510fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:10.493619 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba2f8c03-2dde-4f7e-a43a-a03882d510fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:10.493900 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba2f8c03-2dde-4f7e-a43a-a03882d510fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:10.494481 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba2f8c03-2dde-4f7e-a43a-a03882d510fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:10.495080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba2f8c03-2dde-4f7e-a43a-a03882d510fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:10.630269 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ba2f8c03-2dde-4f7e-a43a-a03882d510fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:10.638726 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ba2f8c03-2dde-4f7e-a43a-a03882d510fd tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.158609 Aug 24 11:30:10.639419 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 295/600] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:10 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:11.507604 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7741bfd8-b957-46a8-acf6-d3031a44934b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:11.508151 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7741bfd8-b957-46a8-acf6-d3031a44934b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:11.514847 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7741bfd8-b957-46a8-acf6-d3031a44934b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:11.515336 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7741bfd8-b957-46a8-acf6-d3031a44934b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:11.515771 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7741bfd8-b957-46a8-acf6-d3031a44934b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:11.516472 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7741bfd8-b957-46a8-acf6-d3031a44934b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:11.516915 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7741bfd8-b957-46a8-acf6-d3031a44934b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:11.517337 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7741bfd8-b957-46a8-acf6-d3031a44934b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:11.657703 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7741bfd8-b957-46a8-acf6-d3031a44934b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:11.661896 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ad692197-12a3-4cf5-a5bc-37e2e8b61be4 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:11.662418 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ad692197-12a3-4cf5-a5bc-37e2e8b61be4 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:11.666509 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7741bfd8-b957-46a8-acf6-d3031a44934b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.162785 Aug 24 11:30:11.667096 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 306/601] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:11 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:11.668921 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ad692197-12a3-4cf5-a5bc-37e2e8b61be4 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:11.669393 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ad692197-12a3-4cf5-a5bc-37e2e8b61be4 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:11.669823 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ad692197-12a3-4cf5-a5bc-37e2e8b61be4 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:11.670527 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ad692197-12a3-4cf5-a5bc-37e2e8b61be4 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:11.670973 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ad692197-12a3-4cf5-a5bc-37e2e8b61be4 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:11.671502 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ad692197-12a3-4cf5-a5bc-37e2e8b61be4 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:11.890587 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ad692197-12a3-4cf5-a5bc-37e2e8b61be4 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:11.903617 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ad692197-12a3-4cf5-a5bc-37e2e8b61be4 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.245737 Aug 24 11:30:11.904218 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 296/602] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:11 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:30:12.688199 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-32be9381-ca88-45fb-95c8-4999ec22f4df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:12.688802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-32be9381-ca88-45fb-95c8-4999ec22f4df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:12.696357 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32be9381-ca88-45fb-95c8-4999ec22f4df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:12.696839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32be9381-ca88-45fb-95c8-4999ec22f4df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:12.697272 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32be9381-ca88-45fb-95c8-4999ec22f4df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:12.698022 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32be9381-ca88-45fb-95c8-4999ec22f4df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:12.698472 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32be9381-ca88-45fb-95c8-4999ec22f4df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:12.698893 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32be9381-ca88-45fb-95c8-4999ec22f4df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:12.828264 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-32be9381-ca88-45fb-95c8-4999ec22f4df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:12.835931 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-32be9381-ca88-45fb-95c8-4999ec22f4df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.151768 Aug 24 11:30:12.836499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 307/603] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:12 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:12.924744 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9103c1ac-9d5c-4231-8c17-5850e694225a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:12.925260 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9103c1ac-9d5c-4231-8c17-5850e694225a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:12.932274 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9103c1ac-9d5c-4231-8c17-5850e694225a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:12.932757 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9103c1ac-9d5c-4231-8c17-5850e694225a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:12.933190 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9103c1ac-9d5c-4231-8c17-5850e694225a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:12.933897 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9103c1ac-9d5c-4231-8c17-5850e694225a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:12.934354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9103c1ac-9d5c-4231-8c17-5850e694225a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:12.934771 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9103c1ac-9d5c-4231-8c17-5850e694225a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:13.063516 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9103c1ac-9d5c-4231-8c17-5850e694225a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:13.071261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9103c1ac-9d5c-4231-8c17-5850e694225a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.150544 Aug 24 11:30:13.071822 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 297/604] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:12 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:13.856783 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2ea039fd-bec8-4d90-b0ba-3abcd4b89302 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:13.857304 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2ea039fd-bec8-4d90-b0ba-3abcd4b89302 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:13.863764 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ea039fd-bec8-4d90-b0ba-3abcd4b89302 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:13.864245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ea039fd-bec8-4d90-b0ba-3abcd4b89302 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:13.864678 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ea039fd-bec8-4d90-b0ba-3abcd4b89302 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:13.865367 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ea039fd-bec8-4d90-b0ba-3abcd4b89302 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:13.865817 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ea039fd-bec8-4d90-b0ba-3abcd4b89302 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:13.866284 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ea039fd-bec8-4d90-b0ba-3abcd4b89302 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:13.997472 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2ea039fd-bec8-4d90-b0ba-3abcd4b89302 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:14.005745 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2ea039fd-bec8-4d90-b0ba-3abcd4b89302 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.152908 Aug 24 11:30:14.006349 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 308/605] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:13 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:14.091899 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-dee6ff8f-fd0e-409d-83a6-a43a58e1cb77 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:14.092503 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-dee6ff8f-fd0e-409d-83a6-a43a58e1cb77 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:14.099066 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dee6ff8f-fd0e-409d-83a6-a43a58e1cb77 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:14.099550 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dee6ff8f-fd0e-409d-83a6-a43a58e1cb77 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:14.099982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dee6ff8f-fd0e-409d-83a6-a43a58e1cb77 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:14.100671 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dee6ff8f-fd0e-409d-83a6-a43a58e1cb77 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:14.101124 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dee6ff8f-fd0e-409d-83a6-a43a58e1cb77 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:14.101545 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dee6ff8f-fd0e-409d-83a6-a43a58e1cb77 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:14.233425 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-dee6ff8f-fd0e-409d-83a6-a43a58e1cb77 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:14.246635 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-dee6ff8f-fd0e-409d-83a6-a43a58e1cb77 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.153923 Aug 24 11:30:14.246635 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 298/606] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:14 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:14.557992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-c211242c-1f7b-4cdd-ad07-2bdf2371ef07 req-c2e966dd-1967-4228-b553-b40cb0d08df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f09e8c6-56b6-426a-8e2c-9d7a35fb1841", "name": "network-vif-plugged", "status": "completed", "tag": "7abd8996-69bf-4018-bb9e-c017b40dc1cd"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:14.567489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-c211242c-1f7b-4cdd-ad07-2bdf2371ef07 req-c2e966dd-1967-4228-b553-b40cb0d08df5 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:14.567963 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-c211242c-1f7b-4cdd-ad07-2bdf2371ef07 req-c2e966dd-1967-4228-b553-b40cb0d08df5 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:14.568391 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-c211242c-1f7b-4cdd-ad07-2bdf2371ef07 req-c2e966dd-1967-4228-b553-b40cb0d08df5 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:14.579288 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-c211242c-1f7b-4cdd-ad07-2bdf2371ef07 req-c2e966dd-1967-4228-b553-b40cb0d08df5 service nova] Creating event network-vif-plugged:7abd8996-69bf-4018-bb9e-c017b40dc1cd for instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 on hv-cinder-85427 Aug 24 11:30:14.584309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-c211242c-1f7b-4cdd-ad07-2bdf2371ef07 req-c2e966dd-1967-4228-b553-b40cb0d08df5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030021 Aug 24 11:30:14.584890 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 309/607] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:15.026447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-202e291b-17d7-46d1-8368-1980b2e1ddc6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:15.027068 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-202e291b-17d7-46d1-8368-1980b2e1ddc6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:15.033013 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-202e291b-17d7-46d1-8368-1980b2e1ddc6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:15.033493 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-202e291b-17d7-46d1-8368-1980b2e1ddc6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:15.033946 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-202e291b-17d7-46d1-8368-1980b2e1ddc6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:15.034639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-202e291b-17d7-46d1-8368-1980b2e1ddc6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:15.035090 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-202e291b-17d7-46d1-8368-1980b2e1ddc6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:15.035510 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-202e291b-17d7-46d1-8368-1980b2e1ddc6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:15.166449 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-202e291b-17d7-46d1-8368-1980b2e1ddc6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:15.174168 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-202e291b-17d7-46d1-8368-1980b2e1ddc6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.151852 Aug 24 11:30:15.174733 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 299/608] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:15 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:15.264869 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-104a9562-8e40-4731-be69-a6c96b83f9e3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:15.265493 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-104a9562-8e40-4731-be69-a6c96b83f9e3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:15.272403 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-104a9562-8e40-4731-be69-a6c96b83f9e3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:15.272879 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-104a9562-8e40-4731-be69-a6c96b83f9e3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:15.273309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-104a9562-8e40-4731-be69-a6c96b83f9e3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:15.274021 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-104a9562-8e40-4731-be69-a6c96b83f9e3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:15.274466 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-104a9562-8e40-4731-be69-a6c96b83f9e3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:15.274876 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-104a9562-8e40-4731-be69-a6c96b83f9e3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:15.414765 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-104a9562-8e40-4731-be69-a6c96b83f9e3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:15.422536 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-104a9562-8e40-4731-be69-a6c96b83f9e3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.162387 Aug 24 11:30:15.423115 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 310/609] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:15 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:16.195749 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f23faac2-286a-47c7-82e5-d110cff57117 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:16.196313 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f23faac2-286a-47c7-82e5-d110cff57117 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:16.202986 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f23faac2-286a-47c7-82e5-d110cff57117 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:16.203473 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f23faac2-286a-47c7-82e5-d110cff57117 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:16.203914 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f23faac2-286a-47c7-82e5-d110cff57117 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:16.204611 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f23faac2-286a-47c7-82e5-d110cff57117 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:16.205068 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f23faac2-286a-47c7-82e5-d110cff57117 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:16.205489 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f23faac2-286a-47c7-82e5-d110cff57117 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:16.343460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f23faac2-286a-47c7-82e5-d110cff57117 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:16.351327 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f23faac2-286a-47c7-82e5-d110cff57117 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.160009 Aug 24 11:30:16.351903 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 300/610] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:16 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:16.444113 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-da034617-4251-4622-b102-2d3151d568d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:16.444850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-da034617-4251-4622-b102-2d3151d568d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:16.451598 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-da034617-4251-4622-b102-2d3151d568d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:16.452014 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-da034617-4251-4622-b102-2d3151d568d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:16.452443 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-da034617-4251-4622-b102-2d3151d568d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:16.453272 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-da034617-4251-4622-b102-2d3151d568d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:16.453723 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-da034617-4251-4622-b102-2d3151d568d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:16.454164 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-da034617-4251-4622-b102-2d3151d568d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:16.588053 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-da034617-4251-4622-b102-2d3151d568d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:16.596118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-da034617-4251-4622-b102-2d3151d568d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.156374 Aug 24 11:30:16.596701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 311/611] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:16 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:17.372955 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-af830439-9935-405c-9811-cc49cc880728 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:17.373563 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-af830439-9935-405c-9811-cc49cc880728 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:17.380309 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-af830439-9935-405c-9811-cc49cc880728 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:17.380803 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-af830439-9935-405c-9811-cc49cc880728 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:17.381441 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-af830439-9935-405c-9811-cc49cc880728 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:17.382162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-af830439-9935-405c-9811-cc49cc880728 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:17.382615 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-af830439-9935-405c-9811-cc49cc880728 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:17.383060 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-af830439-9935-405c-9811-cc49cc880728 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:17.518314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-af830439-9935-405c-9811-cc49cc880728 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:17.527016 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-af830439-9935-405c-9811-cc49cc880728 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.158449 Aug 24 11:30:17.528084 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 301/612] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:17 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:17.617615 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-609cf75f-f09b-4b40-8899-e25ca1a34e37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:17.618263 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-609cf75f-f09b-4b40-8899-e25ca1a34e37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:17.624741 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-609cf75f-f09b-4b40-8899-e25ca1a34e37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:17.625231 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-609cf75f-f09b-4b40-8899-e25ca1a34e37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:17.625676 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-609cf75f-f09b-4b40-8899-e25ca1a34e37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:17.626394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-609cf75f-f09b-4b40-8899-e25ca1a34e37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:17.626849 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-609cf75f-f09b-4b40-8899-e25ca1a34e37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:17.627273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-609cf75f-f09b-4b40-8899-e25ca1a34e37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:17.765416 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-609cf75f-f09b-4b40-8899-e25ca1a34e37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:17.772064 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:17.777926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-609cf75f-f09b-4b40-8899-e25ca1a34e37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.164448 Aug 24 11:30:17.778750 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 312/613] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:17 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:18.547043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c09f6a70-b7bd-4db4-847b-e121a37a90fc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:18.547609 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c09f6a70-b7bd-4db4-847b-e121a37a90fc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:18.555137 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c09f6a70-b7bd-4db4-847b-e121a37a90fc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:18.555617 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c09f6a70-b7bd-4db4-847b-e121a37a90fc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:18.556050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c09f6a70-b7bd-4db4-847b-e121a37a90fc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:18.556747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c09f6a70-b7bd-4db4-847b-e121a37a90fc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:18.557195 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c09f6a70-b7bd-4db4-847b-e121a37a90fc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:18.557673 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c09f6a70-b7bd-4db4-847b-e121a37a90fc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:18.691928 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c09f6a70-b7bd-4db4-847b-e121a37a90fc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:18.699809 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c09f6a70-b7bd-4db4-847b-e121a37a90fc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.156650 Aug 24 11:30:18.700611 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 302/614] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:18 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:18.799181 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1c1e5c0b-aa68-467e-a02a-09a9f541d21b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:18.799791 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1c1e5c0b-aa68-467e-a02a-09a9f541d21b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:18.806892 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c1e5c0b-aa68-467e-a02a-09a9f541d21b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:18.818951 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c1e5c0b-aa68-467e-a02a-09a9f541d21b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:18.818951 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c1e5c0b-aa68-467e-a02a-09a9f541d21b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:18.818951 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c1e5c0b-aa68-467e-a02a-09a9f541d21b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:18.818951 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c1e5c0b-aa68-467e-a02a-09a9f541d21b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:18.819324 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c1e5c0b-aa68-467e-a02a-09a9f541d21b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:18.946083 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1c1e5c0b-aa68-467e-a02a-09a9f541d21b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:18.953780 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1c1e5c0b-aa68-467e-a02a-09a9f541d21b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1357 microversion: 2.1 time: 0.158550 Aug 24 11:30:18.954376 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 313/615] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:18 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:19.157179 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-3e608c24-6c5a-40f5-a442-839dc9b26635 req-c510b4cd-9392-409e-adc5-1b9f1185251b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c2009e-3a3a-4e95-a967-0275cb1fe2b7", "name": "network-vif-plugged", "status": "completed", "tag": "bfbbb09f-cfde-48f3-8c4e-dff38fe58e8d"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:19.166866 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-3e608c24-6c5a-40f5-a442-839dc9b26635 req-c510b4cd-9392-409e-adc5-1b9f1185251b service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:19.167340 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-3e608c24-6c5a-40f5-a442-839dc9b26635 req-c510b4cd-9392-409e-adc5-1b9f1185251b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:19.167790 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-3e608c24-6c5a-40f5-a442-839dc9b26635 req-c510b4cd-9392-409e-adc5-1b9f1185251b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:19.178918 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-3e608c24-6c5a-40f5-a442-839dc9b26635 req-c510b4cd-9392-409e-adc5-1b9f1185251b service nova] Creating event network-vif-plugged:bfbbb09f-cfde-48f3-8c4e-dff38fe58e8d for instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 on hv-cinder-85427 Aug 24 11:30:19.183972 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-3e608c24-6c5a-40f5-a442-839dc9b26635 req-c510b4cd-9392-409e-adc5-1b9f1185251b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030763 Aug 24 11:30:19.184600 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 303/616] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:30:19.720770 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-87f269ba-c3c9-4878-a1c5-b8030c46f727 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:19.721376 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-87f269ba-c3c9-4878-a1c5-b8030c46f727 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:19.727927 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87f269ba-c3c9-4878-a1c5-b8030c46f727 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:19.728413 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87f269ba-c3c9-4878-a1c5-b8030c46f727 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:19.728847 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87f269ba-c3c9-4878-a1c5-b8030c46f727 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:19.729532 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87f269ba-c3c9-4878-a1c5-b8030c46f727 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:19.730007 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87f269ba-c3c9-4878-a1c5-b8030c46f727 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:19.730429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87f269ba-c3c9-4878-a1c5-b8030c46f727 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:19.866878 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-87f269ba-c3c9-4878-a1c5-b8030c46f727 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:19.874633 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-87f269ba-c3c9-4878-a1c5-b8030c46f727 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.157696 Aug 24 11:30:19.875211 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 314/617] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:19 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:19.975818 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-733e2d1d-301f-4087-9066-98ccda3c7db6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:19.976519 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-733e2d1d-301f-4087-9066-98ccda3c7db6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:19.983240 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-733e2d1d-301f-4087-9066-98ccda3c7db6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:19.983823 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-733e2d1d-301f-4087-9066-98ccda3c7db6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:19.984260 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-733e2d1d-301f-4087-9066-98ccda3c7db6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:19.984951 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-733e2d1d-301f-4087-9066-98ccda3c7db6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:19.985404 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-733e2d1d-301f-4087-9066-98ccda3c7db6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:19.985826 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-733e2d1d-301f-4087-9066-98ccda3c7db6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:20.120136 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-733e2d1d-301f-4087-9066-98ccda3c7db6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:20.128270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-733e2d1d-301f-4087-9066-98ccda3c7db6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1547 microversion: 2.1 time: 0.157161 Aug 24 11:30:20.128838 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 304/618] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:19 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:20.150648 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0e2e9eac-aa6d-4ef0-95ef-23730a8b12f1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:20.151268 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0e2e9eac-aa6d-4ef0-95ef-23730a8b12f1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:20.157259 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e2e9eac-aa6d-4ef0-95ef-23730a8b12f1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:20.157746 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e2e9eac-aa6d-4ef0-95ef-23730a8b12f1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:20.158241 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e2e9eac-aa6d-4ef0-95ef-23730a8b12f1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:20.158941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e2e9eac-aa6d-4ef0-95ef-23730a8b12f1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:20.159394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e2e9eac-aa6d-4ef0-95ef-23730a8b12f1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:20.159823 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e2e9eac-aa6d-4ef0-95ef-23730a8b12f1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:20.289548 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0e2e9eac-aa6d-4ef0-95ef-23730a8b12f1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:20.297507 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0e2e9eac-aa6d-4ef0-95ef-23730a8b12f1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1547 microversion: 2.1 time: 0.152301 Aug 24 11:30:20.298110 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 315/619] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:20 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:20.317061 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f958abed-c442-4812-b3a5-69cd98d6f1e1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:20.321787 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f958abed-c442-4812-b3a5-69cd98d6f1e1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:20.322573 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f958abed-c442-4812-b3a5-69cd98d6f1e1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Searching by: {'deleted': False, 'project_id': '7e02d1127ce24c20822ab10c78edb00b'} {{(pid=121222) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 11:30:20.329177 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f958abed-c442-4812-b3a5-69cd98d6f1e1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:20.329659 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f958abed-c442-4812-b3a5-69cd98d6f1e1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:20.330132 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f958abed-c442-4812-b3a5-69cd98d6f1e1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:20.330869 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f958abed-c442-4812-b3a5-69cd98d6f1e1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:20.331314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f958abed-c442-4812-b3a5-69cd98d6f1e1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:20.331732 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f958abed-c442-4812-b3a5-69cd98d6f1e1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:20.421654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.multi_cell_list [None req-f958abed-c442-4812-b3a5-69cd98d6f1e1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121222) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 11:30:20.517062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f958abed-c442-4812-b3a5-69cd98d6f1e1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.203778 Aug 24 11:30:20.517653 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 305/620] 10.222.0.83 () {58 vars in 1125 bytes} [Wed Aug 24 11:30:20 2022] GET /compute/v2.1/servers => generated 341 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:20.529035 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6285b978-68f6-43ad-ad15-2c676fc4108e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:20.529645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6285b978-68f6-43ad-ad15-2c676fc4108e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:20.535614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6285b978-68f6-43ad-ad15-2c676fc4108e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:20.536096 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6285b978-68f6-43ad-ad15-2c676fc4108e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:20.536531 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6285b978-68f6-43ad-ad15-2c676fc4108e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:20.537742 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6285b978-68f6-43ad-ad15-2c676fc4108e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:20.538285 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6285b978-68f6-43ad-ad15-2c676fc4108e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:20.538707 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6285b978-68f6-43ad-ad15-2c676fc4108e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:20.670781 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6285b978-68f6-43ad-ad15-2c676fc4108e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:20.679109 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6285b978-68f6-43ad-ad15-2c676fc4108e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1547 microversion: 2.1 time: 0.154027 Aug 24 11:30:20.679610 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 316/621] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:20 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:20.895077 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-faa613c0-bfbf-45fc-8125-9e4c5d873c19 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:20.895716 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-faa613c0-bfbf-45fc-8125-9e4c5d873c19 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:20.902555 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-faa613c0-bfbf-45fc-8125-9e4c5d873c19 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:20.903047 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-faa613c0-bfbf-45fc-8125-9e4c5d873c19 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:20.903484 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-faa613c0-bfbf-45fc-8125-9e4c5d873c19 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:20.904177 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-faa613c0-bfbf-45fc-8125-9e4c5d873c19 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:20.904630 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-faa613c0-bfbf-45fc-8125-9e4c5d873c19 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:20.905056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-faa613c0-bfbf-45fc-8125-9e4c5d873c19 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:21.043500 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-faa613c0-bfbf-45fc-8125-9e4c5d873c19 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:21.052464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-faa613c0-bfbf-45fc-8125-9e4c5d873c19 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.160086 Aug 24 11:30:21.052464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 306/622] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:20 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:22.078294 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-53a93ce6-6d2e-4ac2-95b7-ed3500ed19f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:22.078904 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-53a93ce6-6d2e-4ac2-95b7-ed3500ed19f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:22.085791 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53a93ce6-6d2e-4ac2-95b7-ed3500ed19f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:22.086304 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53a93ce6-6d2e-4ac2-95b7-ed3500ed19f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:22.086738 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53a93ce6-6d2e-4ac2-95b7-ed3500ed19f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:22.087424 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53a93ce6-6d2e-4ac2-95b7-ed3500ed19f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:22.087875 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53a93ce6-6d2e-4ac2-95b7-ed3500ed19f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:22.088294 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53a93ce6-6d2e-4ac2-95b7-ed3500ed19f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:22.218806 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-53a93ce6-6d2e-4ac2-95b7-ed3500ed19f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:22.226978 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-53a93ce6-6d2e-4ac2-95b7-ed3500ed19f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1365 microversion: 2.1 time: 0.152675 Aug 24 11:30:22.227557 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 317/623] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:22 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:23.247427 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-19e767ad-8329-49de-bf87-0d4fd16b8c77 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:23.248101 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-19e767ad-8329-49de-bf87-0d4fd16b8c77 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:23.254681 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-19e767ad-8329-49de-bf87-0d4fd16b8c77 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:23.255155 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-19e767ad-8329-49de-bf87-0d4fd16b8c77 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:23.256269 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-19e767ad-8329-49de-bf87-0d4fd16b8c77 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:23.256954 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-19e767ad-8329-49de-bf87-0d4fd16b8c77 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:23.257403 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-19e767ad-8329-49de-bf87-0d4fd16b8c77 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:23.257823 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-19e767ad-8329-49de-bf87-0d4fd16b8c77 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:23.387509 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-19e767ad-8329-49de-bf87-0d4fd16b8c77 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:23.395260 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-19e767ad-8329-49de-bf87-0d4fd16b8c77 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1555 microversion: 2.1 time: 0.151684 Aug 24 11:30:23.395819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 307/624] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:23 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:23.415976 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-87997499-4e73-4098-bc3c-e6d99ea481b4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:23.416517 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-87997499-4e73-4098-bc3c-e6d99ea481b4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:23.422963 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87997499-4e73-4098-bc3c-e6d99ea481b4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:23.423439 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87997499-4e73-4098-bc3c-e6d99ea481b4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:23.423868 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87997499-4e73-4098-bc3c-e6d99ea481b4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:23.424550 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87997499-4e73-4098-bc3c-e6d99ea481b4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:23.424999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87997499-4e73-4098-bc3c-e6d99ea481b4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:23.425415 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87997499-4e73-4098-bc3c-e6d99ea481b4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:23.505828 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-87997499-4e73-4098-bc3c-e6d99ea481b4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094146 Aug 24 11:30:23.506450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 318/625] 10.222.0.83 () {58 vars in 1275 bytes} [Wed Aug 24 11:30:23 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:23.825813 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ade38581-cae5-4e68-aa05-f76ac6aadc2a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14169c81-ad70-41d8-8ca2-3a1df810e38e"}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:23.828215 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ade38581-cae5-4e68-aa05-f76ac6aadc2a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:23.834682 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ade38581-cae5-4e68-aa05-f76ac6aadc2a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:23.835180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ade38581-cae5-4e68-aa05-f76ac6aadc2a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:23.835604 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ade38581-cae5-4e68-aa05-f76ac6aadc2a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:23.836296 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ade38581-cae5-4e68-aa05-f76ac6aadc2a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:23.836750 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ade38581-cae5-4e68-aa05-f76ac6aadc2a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:23.837169 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ade38581-cae5-4e68-aa05-f76ac6aadc2a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:24.056421 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:24.536586 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ade38581-cae5-4e68-aa05-f76ac6aadc2a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "POST /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.714453 Aug 24 11:30:24.537427 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 308/626] 10.222.0.83 () {60 vars in 1323 bytes} [Wed Aug 24 11:30:23 2022] POST /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:25.012443 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-8aee3df4-2c1c-4de2-a73c-2c84842f3b6e req-55560949-90fd-43a2-977f-953e75f71c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52c2009e-3a3a-4e95-a967-0275cb1fe2b7", "tag": "bfbbb09f-cfde-48f3-8c4e-dff38fe58e8d"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:25.022481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8aee3df4-2c1c-4de2-a73c-2c84842f3b6e req-55560949-90fd-43a2-977f-953e75f71c34 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:25.023035 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8aee3df4-2c1c-4de2-a73c-2c84842f3b6e req-55560949-90fd-43a2-977f-953e75f71c34 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:25.023527 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8aee3df4-2c1c-4de2-a73c-2c84842f3b6e req-55560949-90fd-43a2-977f-953e75f71c34 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:25.034770 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-8aee3df4-2c1c-4de2-a73c-2c84842f3b6e req-55560949-90fd-43a2-977f-953e75f71c34 service nova] Creating event network-changed:bfbbb09f-cfde-48f3-8c4e-dff38fe58e8d for instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 on hv-cinder-85427 Aug 24 11:30:25.040209 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-8aee3df4-2c1c-4de2-a73c-2c84842f3b6e req-55560949-90fd-43a2-977f-953e75f71c34 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164603 Aug 24 11:30:25.041020 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 319/627] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:34.302893 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5b4a3bfe-2410-4473-b539-4f96ad4be2d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:34.303592 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5b4a3bfe-2410-4473-b539-4f96ad4be2d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:34.306127 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:34.306886 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=53 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:34.312222 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b4a3bfe-2410-4473-b539-4f96ad4be2d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:34.312748 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b4a3bfe-2410-4473-b539-4f96ad4be2d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:34.313138 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b4a3bfe-2410-4473-b539-4f96ad4be2d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:34.313834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b4a3bfe-2410-4473-b539-4f96ad4be2d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:34.314372 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b4a3bfe-2410-4473-b539-4f96ad4be2d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:34.314790 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b4a3bfe-2410-4473-b539-4f96ad4be2d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:34.465171 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5b4a3bfe-2410-4473-b539-4f96ad4be2d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:34.475330 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5b4a3bfe-2410-4473-b539-4f96ad4be2d1 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1593 microversion: 2.1 time: 0.176586 Aug 24 11:30:34.475926 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 309/628] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:34 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1593 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:30:36.833539 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-40dd0714-741a-4240-9495-477b442f2eea req-303c1f35-1f65-4d2f-ad29-4bb040ae0803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f09e8c6-56b6-426a-8e2c-9d7a35fb1841", "tag": "7abd8996-69bf-4018-bb9e-c017b40dc1cd"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:36.851436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=59 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:36.852366 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=36 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:30:36.854699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-40dd0714-741a-4240-9495-477b442f2eea req-303c1f35-1f65-4d2f-ad29-4bb040ae0803 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:36.855426 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-40dd0714-741a-4240-9495-477b442f2eea req-303c1f35-1f65-4d2f-ad29-4bb040ae0803 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:36.856051 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-40dd0714-741a-4240-9495-477b442f2eea req-303c1f35-1f65-4d2f-ad29-4bb040ae0803 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:36.869611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-40dd0714-741a-4240-9495-477b442f2eea req-303c1f35-1f65-4d2f-ad29-4bb040ae0803 service nova] Creating event network-changed:7abd8996-69bf-4018-bb9e-c017b40dc1cd for instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 on hv-cinder-85427 Aug 24 11:30:36.877000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-40dd0714-741a-4240-9495-477b442f2eea req-303c1f35-1f65-4d2f-ad29-4bb040ae0803 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046289 Aug 24 11:30:36.877913 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 320/629] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:30:40.014221 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5a2e44e2-e842-4e08-a8bb-2c0533a8891b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1147142482"}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:40.014815 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5a2e44e2-e842-4e08-a8bb-2c0533a8891b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:40.022238 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5a2e44e2-e842-4e08-a8bb-2c0533a8891b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:40.023749 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5a2e44e2-e842-4e08-a8bb-2c0533a8891b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:40.026030 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5a2e44e2-e842-4e08-a8bb-2c0533a8891b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:40.038188 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5a2e44e2-e842-4e08-a8bb-2c0533a8891b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:40.038188 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5a2e44e2-e842-4e08-a8bb-2c0533a8891b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:40.038188 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5a2e44e2-e842-4e08-a8bb-2c0533a8891b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:40.163055 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.network.security_group_api [None req-5a2e44e2-e842-4e08-a8bb-2c0533a8891b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Adding security group 56192c3c-363c-444b-848e-5493ec688ebd to port 7abd8996-69bf-4018-bb9e-c017b40dc1cd Aug 24 11:30:40.567732 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5a2e44e2-e842-4e08-a8bb-2c0533a8891b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "POST /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/action" status: 202 len: 0 microversion: 2.1 time: 0.557392 Aug 24 11:30:40.568340 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 310/630] 10.222.0.83 () {60 vars in 1278 bytes} [Wed Aug 24 11:30:40 2022] POST /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:30:40.578811 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ba940a7f-a1ea-439f-8a38-c16ef075c949 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:30:40.579436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ba940a7f-a1ea-439f-8a38-c16ef075c949 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:30:40.587003 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba940a7f-a1ea-439f-8a38-c16ef075c949 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:40.587460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba940a7f-a1ea-439f-8a38-c16ef075c949 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:40.587900 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba940a7f-a1ea-439f-8a38-c16ef075c949 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:40.589407 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba940a7f-a1ea-439f-8a38-c16ef075c949 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:40.589407 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba940a7f-a1ea-439f-8a38-c16ef075c949 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:40.589600 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ba940a7f-a1ea-439f-8a38-c16ef075c949 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:40.657449 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-6460a441-f90d-4205-b77e-701fed0d537f req-62475010-9eb9-428d-b09e-11202c35a356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f09e8c6-56b6-426a-8e2c-9d7a35fb1841", "tag": "7abd8996-69bf-4018-bb9e-c017b40dc1cd"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:30:40.668370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-6460a441-f90d-4205-b77e-701fed0d537f req-62475010-9eb9-428d-b09e-11202c35a356 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:30:40.669024 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-6460a441-f90d-4205-b77e-701fed0d537f req-62475010-9eb9-428d-b09e-11202c35a356 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:30:40.669453 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-6460a441-f90d-4205-b77e-701fed0d537f req-62475010-9eb9-428d-b09e-11202c35a356 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:30:40.684315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-6460a441-f90d-4205-b77e-701fed0d537f req-62475010-9eb9-428d-b09e-11202c35a356 service nova] Creating event network-changed:7abd8996-69bf-4018-bb9e-c017b40dc1cd for instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 on hv-cinder-85427 Aug 24 11:30:40.689810 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-6460a441-f90d-4205-b77e-701fed0d537f req-62475010-9eb9-428d-b09e-11202c35a356 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117444 Aug 24 11:30:40.690468 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 321/631] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:30:40.797405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ba940a7f-a1ea-439f-8a38-c16ef075c949 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:30:40.807927 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ba940a7f-a1ea-439f-8a38-c16ef075c949 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1759 microversion: 2.1 time: 0.234828 Aug 24 11:30:40.819464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 311/632] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:30:40 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1759 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:21.363742 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=4 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:21.364499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=4 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:21.368899 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d1399d73-bd5b-4368-8699-522e76269360 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68b5d87e-8649-4c53-b213-006af94cca73"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:21.371268 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d1399d73-bd5b-4368-8699-522e76269360 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:21.377294 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d1399d73-bd5b-4368-8699-522e76269360 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:21.377777 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d1399d73-bd5b-4368-8699-522e76269360 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:21.378241 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d1399d73-bd5b-4368-8699-522e76269360 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:21.378941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d1399d73-bd5b-4368-8699-522e76269360 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:21.379392 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d1399d73-bd5b-4368-8699-522e76269360 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:21.379814 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d1399d73-bd5b-4368-8699-522e76269360 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:22.154008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d1399d73-bd5b-4368-8699-522e76269360 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "POST /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.792199 Aug 24 11:31:22.154643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 322/633] 10.222.0.83 () {60 vars in 1323 bytes} [Wed Aug 24 11:31:21 2022] POST /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments => generated 194 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:31:27.777211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a05a6985-147d-441d-9a1d-ac97003252b8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:27.777776 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a05a6985-147d-441d-9a1d-ac97003252b8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:27.779740 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=6 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:27.780392 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:27.785051 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a05a6985-147d-441d-9a1d-ac97003252b8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:27.785527 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a05a6985-147d-441d-9a1d-ac97003252b8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:27.786092 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a05a6985-147d-441d-9a1d-ac97003252b8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:27.786785 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a05a6985-147d-441d-9a1d-ac97003252b8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:27.787234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a05a6985-147d-441d-9a1d-ac97003252b8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:27.788592 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a05a6985-147d-441d-9a1d-ac97003252b8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:27.933616 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-a05a6985-147d-441d-9a1d-ac97003252b8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lazy-loading 'services' on Instance uuid b611366f-7de9-4b85-8464-8a9b8aaed0c5 {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:31:28.189245 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a05a6985-147d-441d-9a1d-ac97003252b8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/os-volume_attachments/7735a01b-d9fe-449e-b2d4-7ba4f20e636d" status: 202 len: 0 microversion: 2.1 time: 0.415453 Aug 24 11:31:28.190673 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 312/634] 10.222.0.83 () {58 vars in 1416 bytes} [Wed Aug 24 11:31:27 2022] DELETE /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/os-volume_attachments/7735a01b-d9fe-449e-b2d4-7ba4f20e636d => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:31:30.739250 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-29c88ed0-7655-4dfd-a747-0259c2357190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:30.741599 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-29c88ed0-7655-4dfd-a747-0259c2357190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:30.747770 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29c88ed0-7655-4dfd-a747-0259c2357190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:30.748251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29c88ed0-7655-4dfd-a747-0259c2357190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:30.748681 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29c88ed0-7655-4dfd-a747-0259c2357190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:30.749369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29c88ed0-7655-4dfd-a747-0259c2357190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:30.749816 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29c88ed0-7655-4dfd-a747-0259c2357190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:30.750262 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29c88ed0-7655-4dfd-a747-0259c2357190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:30.774512 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-29c88ed0-7655-4dfd-a747-0259c2357190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lazy-loading 'flavor' on Instance uuid c2aa046f-53cb-4392-9270-8f1d3b977f16 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:31:31.093804 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-29c88ed0-7655-4dfd-a747-0259c2357190 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "POST /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/action" status: 200 len: 32 microversion: 2.1 time: 0.359237 Aug 24 11:31:31.094413 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 323/635] 10.222.0.83 () {60 vars in 1278 bytes} [Wed Aug 24 11:31:30 2022] POST /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/action => generated 32 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:31:31.105360 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f5ef3643-717b-4289-9e96-42ecf42183b4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:31.106934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f5ef3643-717b-4289-9e96-42ecf42183b4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:31.112850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f5ef3643-717b-4289-9e96-42ecf42183b4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:31.113326 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f5ef3643-717b-4289-9e96-42ecf42183b4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:31.113750 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f5ef3643-717b-4289-9e96-42ecf42183b4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:31.114455 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f5ef3643-717b-4289-9e96-42ecf42183b4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:31.114907 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f5ef3643-717b-4289-9e96-42ecf42183b4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:31.115312 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f5ef3643-717b-4289-9e96-42ecf42183b4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:31.253266 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f5ef3643-717b-4289-9e96-42ecf42183b4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:31.262212 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f5ef3643-717b-4289-9e96-42ecf42183b4 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.161425 Aug 24 11:31:31.263183 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 313/636] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:31 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:32.284882 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b7815a1a-0feb-45d5-b766-6a44d7b2c169 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:32.285598 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b7815a1a-0feb-45d5-b766-6a44d7b2c169 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:32.292445 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7815a1a-0feb-45d5-b766-6a44d7b2c169 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:32.292944 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7815a1a-0feb-45d5-b766-6a44d7b2c169 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:32.293394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7815a1a-0feb-45d5-b766-6a44d7b2c169 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:32.294185 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7815a1a-0feb-45d5-b766-6a44d7b2c169 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:32.294646 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7815a1a-0feb-45d5-b766-6a44d7b2c169 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:32.295074 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7815a1a-0feb-45d5-b766-6a44d7b2c169 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:32.431208 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b7815a1a-0feb-45d5-b766-6a44d7b2c169 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:32.439930 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b7815a1a-0feb-45d5-b766-6a44d7b2c169 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.158828 Aug 24 11:31:32.440507 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 324/637] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:32 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:32.479961 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e6881e7b-2e1b-4e5e-87af-4f0fa903690a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:32.486474 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e6881e7b-2e1b-4e5e-87af-4f0fa903690a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:32.487897 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e6881e7b-2e1b-4e5e-87af-4f0fa903690a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:32.488328 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e6881e7b-2e1b-4e5e-87af-4f0fa903690a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:32.510350 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e6881e7b-2e1b-4e5e-87af-4f0fa903690a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Going to try to stop instance {{(pid=121222) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 11:31:32.710737 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e6881e7b-2e1b-4e5e-87af-4f0fa903690a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "POST /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/action" status: 202 len: 0 microversion: 2.1 time: 0.234307 Aug 24 11:31:32.712687 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 314/638] 10.222.0.83 () {60 vars in 1278 bytes} [Wed Aug 24 11:31:32 2022] POST /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:31:32.722142 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8f3baf2d-32e1-476e-a855-f3ee256b15d8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:32.722755 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8f3baf2d-32e1-476e-a855-f3ee256b15d8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:32.728750 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8f3baf2d-32e1-476e-a855-f3ee256b15d8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:32.729236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8f3baf2d-32e1-476e-a855-f3ee256b15d8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:32.729674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8f3baf2d-32e1-476e-a855-f3ee256b15d8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:32.730401 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8f3baf2d-32e1-476e-a855-f3ee256b15d8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:32.730872 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8f3baf2d-32e1-476e-a855-f3ee256b15d8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:32.731270 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8f3baf2d-32e1-476e-a855-f3ee256b15d8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:32.861255 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8f3baf2d-32e1-476e-a855-f3ee256b15d8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:32.869169 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8f3baf2d-32e1-476e-a855-f3ee256b15d8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1673 microversion: 2.1 time: 0.153091 Aug 24 11:31:32.869742 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 325/639] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:32 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:33.446162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:31:33.446456 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Wed Aug 24 11:31:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:31:33.461758 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4a5c67bb-20ff-4d29-8414-1d54bf379e36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:33.462473 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4a5c67bb-20ff-4d29-8414-1d54bf379e36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:33.468578 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a5c67bb-20ff-4d29-8414-1d54bf379e36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:33.469047 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a5c67bb-20ff-4d29-8414-1d54bf379e36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:33.469620 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a5c67bb-20ff-4d29-8414-1d54bf379e36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:33.470334 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a5c67bb-20ff-4d29-8414-1d54bf379e36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:33.471310 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a5c67bb-20ff-4d29-8414-1d54bf379e36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:33.471724 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a5c67bb-20ff-4d29-8414-1d54bf379e36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:33.605113 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4a5c67bb-20ff-4d29-8414-1d54bf379e36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:33.614091 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4a5c67bb-20ff-4d29-8414-1d54bf379e36 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.156514 Aug 24 11:31:33.614668 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 315/640] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:33 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:33.891082 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-17e3f683-bd3c-4d53-8b86-956e1f39c44e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:33.891632 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-17e3f683-bd3c-4d53-8b86-956e1f39c44e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:33.898327 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17e3f683-bd3c-4d53-8b86-956e1f39c44e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:33.898806 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17e3f683-bd3c-4d53-8b86-956e1f39c44e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:33.899236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17e3f683-bd3c-4d53-8b86-956e1f39c44e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:33.899920 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17e3f683-bd3c-4d53-8b86-956e1f39c44e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:33.900373 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17e3f683-bd3c-4d53-8b86-956e1f39c44e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:33.900795 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17e3f683-bd3c-4d53-8b86-956e1f39c44e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:34.026868 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-17e3f683-bd3c-4d53-8b86-956e1f39c44e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:34.035034 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-17e3f683-bd3c-4d53-8b86-956e1f39c44e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1673 microversion: 2.1 time: 0.147884 Aug 24 11:31:34.035592 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 326/641] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:33 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:34.635149 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-37cb1984-8108-4465-a8d9-f0addbb6e130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:34.635689 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-37cb1984-8108-4465-a8d9-f0addbb6e130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:34.642024 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37cb1984-8108-4465-a8d9-f0addbb6e130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:34.644827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37cb1984-8108-4465-a8d9-f0addbb6e130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:34.644827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37cb1984-8108-4465-a8d9-f0addbb6e130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:34.644827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37cb1984-8108-4465-a8d9-f0addbb6e130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:34.644827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37cb1984-8108-4465-a8d9-f0addbb6e130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:34.645296 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37cb1984-8108-4465-a8d9-f0addbb6e130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:34.772925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-37cb1984-8108-4465-a8d9-f0addbb6e130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:34.781423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-37cb1984-8108-4465-a8d9-f0addbb6e130 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.150214 Aug 24 11:31:34.782006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 316/642] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:34 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:35.055931 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a564f324-c838-46ff-85b4-c464e2ee7a89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:35.056538 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a564f324-c838-46ff-85b4-c464e2ee7a89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:35.063028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a564f324-c838-46ff-85b4-c464e2ee7a89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:35.063521 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a564f324-c838-46ff-85b4-c464e2ee7a89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:35.063952 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a564f324-c838-46ff-85b4-c464e2ee7a89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:35.065214 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a564f324-c838-46ff-85b4-c464e2ee7a89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:35.065667 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a564f324-c838-46ff-85b4-c464e2ee7a89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:35.066193 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a564f324-c838-46ff-85b4-c464e2ee7a89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:35.197446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a564f324-c838-46ff-85b4-c464e2ee7a89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:35.205801 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a564f324-c838-46ff-85b4-c464e2ee7a89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1673 microversion: 2.1 time: 0.153771 Aug 24 11:31:35.206413 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 327/643] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:35 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:35.803273 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-88f9befd-7182-443f-92da-81dd9d46765b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:35.803887 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-88f9befd-7182-443f-92da-81dd9d46765b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:35.810351 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-88f9befd-7182-443f-92da-81dd9d46765b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:35.810840 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-88f9befd-7182-443f-92da-81dd9d46765b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:35.811274 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-88f9befd-7182-443f-92da-81dd9d46765b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:35.811958 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-88f9befd-7182-443f-92da-81dd9d46765b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:35.812411 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-88f9befd-7182-443f-92da-81dd9d46765b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:35.812834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-88f9befd-7182-443f-92da-81dd9d46765b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:35.944567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-88f9befd-7182-443f-92da-81dd9d46765b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:35.952762 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-88f9befd-7182-443f-92da-81dd9d46765b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.153334 Aug 24 11:31:35.953326 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 317/644] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:35 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:36.226073 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2014690a-1023-4dde-af28-a4a6de1235ed tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:36.226665 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2014690a-1023-4dde-af28-a4a6de1235ed tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:36.233208 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2014690a-1023-4dde-af28-a4a6de1235ed tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:36.233700 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2014690a-1023-4dde-af28-a4a6de1235ed tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:36.234168 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2014690a-1023-4dde-af28-a4a6de1235ed tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:36.234887 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2014690a-1023-4dde-af28-a4a6de1235ed tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:36.235454 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2014690a-1023-4dde-af28-a4a6de1235ed tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:36.235925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2014690a-1023-4dde-af28-a4a6de1235ed tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:36.363587 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2014690a-1023-4dde-af28-a4a6de1235ed tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:36.371372 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2014690a-1023-4dde-af28-a4a6de1235ed tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1673 microversion: 2.1 time: 0.149298 Aug 24 11:31:36.371943 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 328/645] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:36 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:36.972982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-02da57e1-ceb0-4ea6-99d4-e45231bcb0cd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:36.973569 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-02da57e1-ceb0-4ea6-99d4-e45231bcb0cd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:36.979995 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-02da57e1-ceb0-4ea6-99d4-e45231bcb0cd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:36.980482 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-02da57e1-ceb0-4ea6-99d4-e45231bcb0cd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:36.980921 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-02da57e1-ceb0-4ea6-99d4-e45231bcb0cd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:36.981617 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-02da57e1-ceb0-4ea6-99d4-e45231bcb0cd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:36.982103 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-02da57e1-ceb0-4ea6-99d4-e45231bcb0cd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:36.982524 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-02da57e1-ceb0-4ea6-99d4-e45231bcb0cd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:37.118382 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-02da57e1-ceb0-4ea6-99d4-e45231bcb0cd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:37.126796 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-02da57e1-ceb0-4ea6-99d4-e45231bcb0cd tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.158076 Aug 24 11:31:37.127375 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 318/646] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:36 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:37.393267 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-99e048b8-2ea1-434b-bced-05cba097a18c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:37.393899 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-99e048b8-2ea1-434b-bced-05cba097a18c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:37.400859 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99e048b8-2ea1-434b-bced-05cba097a18c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:37.401435 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99e048b8-2ea1-434b-bced-05cba097a18c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:37.401835 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99e048b8-2ea1-434b-bced-05cba097a18c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:37.402554 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99e048b8-2ea1-434b-bced-05cba097a18c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:37.403009 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99e048b8-2ea1-434b-bced-05cba097a18c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:37.403432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99e048b8-2ea1-434b-bced-05cba097a18c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:37.541818 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-99e048b8-2ea1-434b-bced-05cba097a18c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:37.549688 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-99e048b8-2ea1-434b-bced-05cba097a18c tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1673 microversion: 2.1 time: 0.160950 Aug 24 11:31:37.550291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 329/647] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:37 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:38.147962 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-62c157ea-55ae-49da-9613-99a0bc6ee4a9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:38.148567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-62c157ea-55ae-49da-9613-99a0bc6ee4a9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:38.154788 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-62c157ea-55ae-49da-9613-99a0bc6ee4a9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:38.155266 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-62c157ea-55ae-49da-9613-99a0bc6ee4a9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:38.155696 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-62c157ea-55ae-49da-9613-99a0bc6ee4a9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:38.156375 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-62c157ea-55ae-49da-9613-99a0bc6ee4a9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:38.156819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-62c157ea-55ae-49da-9613-99a0bc6ee4a9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:38.157232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-62c157ea-55ae-49da-9613-99a0bc6ee4a9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:38.289065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-62c157ea-55ae-49da-9613-99a0bc6ee4a9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:38.297309 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-62c157ea-55ae-49da-9613-99a0bc6ee4a9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.153449 Aug 24 11:31:38.297897 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 319/648] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:38 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:38.570523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-73356c0e-6088-4ebe-b109-0e038c3f7abc tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:38.571135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-73356c0e-6088-4ebe-b109-0e038c3f7abc tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:38.577608 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73356c0e-6088-4ebe-b109-0e038c3f7abc tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:38.578132 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73356c0e-6088-4ebe-b109-0e038c3f7abc tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:38.578568 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73356c0e-6088-4ebe-b109-0e038c3f7abc tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:38.579265 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73356c0e-6088-4ebe-b109-0e038c3f7abc tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:38.579717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73356c0e-6088-4ebe-b109-0e038c3f7abc tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:38.580143 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73356c0e-6088-4ebe-b109-0e038c3f7abc tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:38.717616 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-73356c0e-6088-4ebe-b109-0e038c3f7abc tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:38.726034 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-73356c0e-6088-4ebe-b109-0e038c3f7abc tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1673 microversion: 2.1 time: 0.159393 Aug 24 11:31:38.726608 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 330/649] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:38 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:39.318969 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-50121dcc-7abc-4442-a190-9e6688eafc03 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:39.319574 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-50121dcc-7abc-4442-a190-9e6688eafc03 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:39.326123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-50121dcc-7abc-4442-a190-9e6688eafc03 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:39.327235 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-50121dcc-7abc-4442-a190-9e6688eafc03 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:39.327235 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-50121dcc-7abc-4442-a190-9e6688eafc03 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:39.327839 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-50121dcc-7abc-4442-a190-9e6688eafc03 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:39.328287 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-50121dcc-7abc-4442-a190-9e6688eafc03 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:39.328707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-50121dcc-7abc-4442-a190-9e6688eafc03 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:39.459937 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-50121dcc-7abc-4442-a190-9e6688eafc03 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:39.468568 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-50121dcc-7abc-4442-a190-9e6688eafc03 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.153476 Aug 24 11:31:39.469140 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 320/650] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:39 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:39.747471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-17752eab-f904-4442-8a9d-4eb4ede03364 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:39.748082 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-17752eab-f904-4442-8a9d-4eb4ede03364 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:39.755100 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17752eab-f904-4442-8a9d-4eb4ede03364 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:39.755593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17752eab-f904-4442-8a9d-4eb4ede03364 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:39.756031 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17752eab-f904-4442-8a9d-4eb4ede03364 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:39.756721 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17752eab-f904-4442-8a9d-4eb4ede03364 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:39.757179 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17752eab-f904-4442-8a9d-4eb4ede03364 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:39.757608 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17752eab-f904-4442-8a9d-4eb4ede03364 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:39.884016 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-17752eab-f904-4442-8a9d-4eb4ede03364 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:39.891642 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-17752eab-f904-4442-8a9d-4eb4ede03364 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1673 microversion: 2.1 time: 0.148037 Aug 24 11:31:39.892215 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 331/651] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:39 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:40.490615 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4a03fa49-0971-4bda-8ed7-14de5d599782 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:40.491217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4a03fa49-0971-4bda-8ed7-14de5d599782 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:40.497969 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a03fa49-0971-4bda-8ed7-14de5d599782 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:40.498451 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a03fa49-0971-4bda-8ed7-14de5d599782 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:40.498888 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a03fa49-0971-4bda-8ed7-14de5d599782 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:40.499598 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a03fa49-0971-4bda-8ed7-14de5d599782 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:40.500050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a03fa49-0971-4bda-8ed7-14de5d599782 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:40.500461 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a03fa49-0971-4bda-8ed7-14de5d599782 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:40.631240 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4a03fa49-0971-4bda-8ed7-14de5d599782 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:40.639517 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4a03fa49-0971-4bda-8ed7-14de5d599782 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.152830 Aug 24 11:31:40.640071 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 321/652] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:40 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:40.913293 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9e4ab89b-12d3-4795-a10b-76edca0060a2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:40.913831 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9e4ab89b-12d3-4795-a10b-76edca0060a2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:40.920206 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e4ab89b-12d3-4795-a10b-76edca0060a2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:40.920834 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e4ab89b-12d3-4795-a10b-76edca0060a2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:40.921289 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e4ab89b-12d3-4795-a10b-76edca0060a2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:40.922002 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e4ab89b-12d3-4795-a10b-76edca0060a2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:40.922463 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e4ab89b-12d3-4795-a10b-76edca0060a2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:40.922887 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e4ab89b-12d3-4795-a10b-76edca0060a2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:41.052382 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9e4ab89b-12d3-4795-a10b-76edca0060a2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:41.060147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9e4ab89b-12d3-4795-a10b-76edca0060a2 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1673 microversion: 2.1 time: 0.150807 Aug 24 11:31:41.060817 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 332/653] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:40 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:41.661814 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-57297811-f2bd-4706-9567-54dd0cc49b53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:41.662453 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-57297811-f2bd-4706-9567-54dd0cc49b53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:41.669213 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-57297811-f2bd-4706-9567-54dd0cc49b53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:41.669702 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-57297811-f2bd-4706-9567-54dd0cc49b53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:41.670171 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-57297811-f2bd-4706-9567-54dd0cc49b53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:41.670858 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-57297811-f2bd-4706-9567-54dd0cc49b53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:41.671313 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-57297811-f2bd-4706-9567-54dd0cc49b53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:41.671737 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-57297811-f2bd-4706-9567-54dd0cc49b53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:41.804242 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-57297811-f2bd-4706-9567-54dd0cc49b53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:41.813065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-57297811-f2bd-4706-9567-54dd0cc49b53 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.155694 Aug 24 11:31:41.813631 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 322/654] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:41 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:42.081399 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-59250a5f-331d-4b66-b3e1-b62d01a375a8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:42.082073 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-59250a5f-331d-4b66-b3e1-b62d01a375a8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:42.088390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59250a5f-331d-4b66-b3e1-b62d01a375a8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:42.088867 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59250a5f-331d-4b66-b3e1-b62d01a375a8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:42.089455 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59250a5f-331d-4b66-b3e1-b62d01a375a8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:42.090161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59250a5f-331d-4b66-b3e1-b62d01a375a8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:42.090616 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59250a5f-331d-4b66-b3e1-b62d01a375a8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:42.091034 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59250a5f-331d-4b66-b3e1-b62d01a375a8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:42.219786 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-59250a5f-331d-4b66-b3e1-b62d01a375a8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:42.227518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-59250a5f-331d-4b66-b3e1-b62d01a375a8 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1673 microversion: 2.1 time: 0.150434 Aug 24 11:31:42.228083 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 333/655] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:42 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:42.834672 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-fbdea085-be4d-49db-bf86-5d636b8ff8c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:42.835514 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-fbdea085-be4d-49db-bf86-5d636b8ff8c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:42.842139 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fbdea085-be4d-49db-bf86-5d636b8ff8c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:42.842616 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fbdea085-be4d-49db-bf86-5d636b8ff8c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:42.843043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fbdea085-be4d-49db-bf86-5d636b8ff8c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:42.843725 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fbdea085-be4d-49db-bf86-5d636b8ff8c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:42.844168 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fbdea085-be4d-49db-bf86-5d636b8ff8c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:42.844608 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fbdea085-be4d-49db-bf86-5d636b8ff8c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:42.973681 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-fbdea085-be4d-49db-bf86-5d636b8ff8c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:42.982169 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-fbdea085-be4d-49db-bf86-5d636b8ff8c0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.151362 Aug 24 11:31:42.982727 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 323/656] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:42 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:43.248555 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2273af16-8e1b-4200-adf8-760300e8ac00 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:43.249157 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2273af16-8e1b-4200-adf8-760300e8ac00 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:43.256200 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2273af16-8e1b-4200-adf8-760300e8ac00 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:43.256674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2273af16-8e1b-4200-adf8-760300e8ac00 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:43.257103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2273af16-8e1b-4200-adf8-760300e8ac00 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:43.257778 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2273af16-8e1b-4200-adf8-760300e8ac00 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:43.258266 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2273af16-8e1b-4200-adf8-760300e8ac00 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:43.258682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2273af16-8e1b-4200-adf8-760300e8ac00 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:43.391649 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2273af16-8e1b-4200-adf8-760300e8ac00 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:43.399726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2273af16-8e1b-4200-adf8-760300e8ac00 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1673 microversion: 2.1 time: 0.155198 Aug 24 11:31:43.400311 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 334/657] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:43 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:44.003717 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-098bb42b-bdd8-4809-b065-8b60eead5180 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:44.004318 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-098bb42b-bdd8-4809-b065-8b60eead5180 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:44.010875 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-098bb42b-bdd8-4809-b065-8b60eead5180 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:44.011362 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-098bb42b-bdd8-4809-b065-8b60eead5180 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:44.011788 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-098bb42b-bdd8-4809-b065-8b60eead5180 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:44.012586 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-098bb42b-bdd8-4809-b065-8b60eead5180 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:44.013036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-098bb42b-bdd8-4809-b065-8b60eead5180 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:44.013449 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-098bb42b-bdd8-4809-b065-8b60eead5180 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:44.142783 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-098bb42b-bdd8-4809-b065-8b60eead5180 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:44.151643 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-098bb42b-bdd8-4809-b065-8b60eead5180 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.152285 Aug 24 11:31:44.152544 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 324/658] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:43 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:44.421013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c2b27e87-c5c2-407c-b6a1-4f79fdc438cb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:44.421635 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c2b27e87-c5c2-407c-b6a1-4f79fdc438cb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:44.428338 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b27e87-c5c2-407c-b6a1-4f79fdc438cb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:44.428821 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b27e87-c5c2-407c-b6a1-4f79fdc438cb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:44.429255 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b27e87-c5c2-407c-b6a1-4f79fdc438cb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:44.429971 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b27e87-c5c2-407c-b6a1-4f79fdc438cb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:44.430425 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b27e87-c5c2-407c-b6a1-4f79fdc438cb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:44.430853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b27e87-c5c2-407c-b6a1-4f79fdc438cb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:44.435117 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:44.623495 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c2b27e87-c5c2-407c-b6a1-4f79fdc438cb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:44.631923 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c2b27e87-c5c2-407c-b6a1-4f79fdc438cb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1650 microversion: 2.1 time: 0.214832 Aug 24 11:31:44.635120 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 335/659] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:44 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1650 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:44.652236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9ff9113a-52bb-4e5b-ba1b-1241deecf002 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:44.658892 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ff9113a-52bb-4e5b-ba1b-1241deecf002 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:44.659381 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ff9113a-52bb-4e5b-ba1b-1241deecf002 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:44.663602 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ff9113a-52bb-4e5b-ba1b-1241deecf002 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:44.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9ff9113a-52bb-4e5b-ba1b-1241deecf002 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Going to try to start instance {{(pid=121222) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 11:31:44.786084 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:44.929176 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9ff9113a-52bb-4e5b-ba1b-1241deecf002 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "POST /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/action" status: 202 len: 0 microversion: 2.1 time: 0.280585 Aug 24 11:31:44.929724 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 325/660] 10.222.0.83 () {60 vars in 1278 bytes} [Wed Aug 24 11:31:44 2022] POST /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:31:44.939338 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-09231a19-23b6-4b54-8d8c-7a0f5bf38085 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:44.939949 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-09231a19-23b6-4b54-8d8c-7a0f5bf38085 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:44.945778 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-09231a19-23b6-4b54-8d8c-7a0f5bf38085 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:44.946479 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-09231a19-23b6-4b54-8d8c-7a0f5bf38085 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:44.946913 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-09231a19-23b6-4b54-8d8c-7a0f5bf38085 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:44.947599 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-09231a19-23b6-4b54-8d8c-7a0f5bf38085 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:44.948046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-09231a19-23b6-4b54-8d8c-7a0f5bf38085 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:44.948463 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-09231a19-23b6-4b54-8d8c-7a0f5bf38085 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:45.083128 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-09231a19-23b6-4b54-8d8c-7a0f5bf38085 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:45.090863 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-09231a19-23b6-4b54-8d8c-7a0f5bf38085 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1659 microversion: 2.1 time: 0.156145 Aug 24 11:31:45.092093 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 336/661] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:44 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1659 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:45.173971 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-545428a7-4e90-42f4-a9b1-0fb394a069cc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:45.174945 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-545428a7-4e90-42f4-a9b1-0fb394a069cc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:45.181780 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-545428a7-4e90-42f4-a9b1-0fb394a069cc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:45.182221 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-545428a7-4e90-42f4-a9b1-0fb394a069cc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:45.182659 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-545428a7-4e90-42f4-a9b1-0fb394a069cc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:45.183354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-545428a7-4e90-42f4-a9b1-0fb394a069cc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:45.183802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-545428a7-4e90-42f4-a9b1-0fb394a069cc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:45.184226 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-545428a7-4e90-42f4-a9b1-0fb394a069cc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:45.395382 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-545428a7-4e90-42f4-a9b1-0fb394a069cc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:45.404339 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-545428a7-4e90-42f4-a9b1-0fb394a069cc tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.235426 Aug 24 11:31:45.404934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 326/662] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:45 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:46.112548 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-45293e16-390c-42fb-a46e-c2e90f8abcad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:46.113156 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-45293e16-390c-42fb-a46e-c2e90f8abcad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:46.119684 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-45293e16-390c-42fb-a46e-c2e90f8abcad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:46.120163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-45293e16-390c-42fb-a46e-c2e90f8abcad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:46.120596 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-45293e16-390c-42fb-a46e-c2e90f8abcad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:46.121278 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-45293e16-390c-42fb-a46e-c2e90f8abcad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:46.121725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-45293e16-390c-42fb-a46e-c2e90f8abcad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:46.122173 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-45293e16-390c-42fb-a46e-c2e90f8abcad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:46.252142 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-45293e16-390c-42fb-a46e-c2e90f8abcad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:46.260084 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-45293e16-390c-42fb-a46e-c2e90f8abcad tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1659 microversion: 2.1 time: 0.151371 Aug 24 11:31:46.260650 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 337/663] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:46 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1659 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:46.425139 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-796fc29f-ac86-46e3-bf74-eca6fc0d03ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:46.429694 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-796fc29f-ac86-46e3-bf74-eca6fc0d03ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:46.432340 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-796fc29f-ac86-46e3-bf74-eca6fc0d03ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:46.432831 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-796fc29f-ac86-46e3-bf74-eca6fc0d03ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:46.433267 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-796fc29f-ac86-46e3-bf74-eca6fc0d03ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:46.434009 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-796fc29f-ac86-46e3-bf74-eca6fc0d03ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:46.434464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-796fc29f-ac86-46e3-bf74-eca6fc0d03ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:46.434889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-796fc29f-ac86-46e3-bf74-eca6fc0d03ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:46.570264 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-796fc29f-ac86-46e3-bf74-eca6fc0d03ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:46.578689 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-796fc29f-ac86-46e3-bf74-eca6fc0d03ec tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.158012 Aug 24 11:31:46.579760 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 327/664] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:46 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:31:47.281929 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-11961e58-8e34-4e7f-a3f1-9909cf4e1439 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:47.282564 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-11961e58-8e34-4e7f-a3f1-9909cf4e1439 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:47.289031 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11961e58-8e34-4e7f-a3f1-9909cf4e1439 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:47.289508 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11961e58-8e34-4e7f-a3f1-9909cf4e1439 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:47.289961 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11961e58-8e34-4e7f-a3f1-9909cf4e1439 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:47.290642 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11961e58-8e34-4e7f-a3f1-9909cf4e1439 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:47.291088 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11961e58-8e34-4e7f-a3f1-9909cf4e1439 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:47.291500 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11961e58-8e34-4e7f-a3f1-9909cf4e1439 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:47.422647 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-11961e58-8e34-4e7f-a3f1-9909cf4e1439 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:47.431091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-11961e58-8e34-4e7f-a3f1-9909cf4e1439 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1663 microversion: 2.1 time: 0.153039 Aug 24 11:31:47.431723 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 338/665] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:47 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:47.600186 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5b8aa469-c0ae-4086-b1ca-c140a34e19d3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:47.600797 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5b8aa469-c0ae-4086-b1ca-c140a34e19d3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:47.607283 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b8aa469-c0ae-4086-b1ca-c140a34e19d3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:47.607769 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b8aa469-c0ae-4086-b1ca-c140a34e19d3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:47.608207 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b8aa469-c0ae-4086-b1ca-c140a34e19d3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:47.608901 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b8aa469-c0ae-4086-b1ca-c140a34e19d3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:47.609358 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b8aa469-c0ae-4086-b1ca-c140a34e19d3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:47.609782 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b8aa469-c0ae-4086-b1ca-c140a34e19d3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:47.741180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5b8aa469-c0ae-4086-b1ca-c140a34e19d3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:47.749481 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5b8aa469-c0ae-4086-b1ca-c140a34e19d3 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.153207 Aug 24 11:31:47.750085 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 328/666] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:47 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:48.770735 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6d752e18-402d-4f4d-922b-3f67205e61c7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:48.771560 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6d752e18-402d-4f4d-922b-3f67205e61c7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:48.777856 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d752e18-402d-4f4d-922b-3f67205e61c7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:48.778364 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d752e18-402d-4f4d-922b-3f67205e61c7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:48.778793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d752e18-402d-4f4d-922b-3f67205e61c7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:48.779514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d752e18-402d-4f4d-922b-3f67205e61c7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:48.779959 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d752e18-402d-4f4d-922b-3f67205e61c7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:48.780374 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d752e18-402d-4f4d-922b-3f67205e61c7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:48.912081 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6d752e18-402d-4f4d-922b-3f67205e61c7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:48.924275 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6d752e18-402d-4f4d-922b-3f67205e61c7 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.157942 Aug 24 11:31:48.925095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 339/667] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:48 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:49.947283 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2fc972ea-5df4-4766-9655-7f9316664db6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:49.947897 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-2fc972ea-5df4-4766-9655-7f9316664db6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:49.955459 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2fc972ea-5df4-4766-9655-7f9316664db6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:49.955956 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2fc972ea-5df4-4766-9655-7f9316664db6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:49.956399 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2fc972ea-5df4-4766-9655-7f9316664db6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:49.957106 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2fc972ea-5df4-4766-9655-7f9316664db6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:49.957567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2fc972ea-5df4-4766-9655-7f9316664db6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:49.958023 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2fc972ea-5df4-4766-9655-7f9316664db6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:50.148708 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-2fc972ea-5df4-4766-9655-7f9316664db6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:50.157660 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-2fc972ea-5df4-4766-9655-7f9316664db6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.213699 Aug 24 11:31:50.158268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 329/668] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:49 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:51.178706 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-96528186-9494-4e2f-a76c-bab3d7e27094 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:51.179318 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-96528186-9494-4e2f-a76c-bab3d7e27094 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:51.185726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96528186-9494-4e2f-a76c-bab3d7e27094 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:51.186237 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96528186-9494-4e2f-a76c-bab3d7e27094 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:51.186670 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96528186-9494-4e2f-a76c-bab3d7e27094 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:51.187358 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96528186-9494-4e2f-a76c-bab3d7e27094 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:51.187808 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96528186-9494-4e2f-a76c-bab3d7e27094 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:51.188731 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96528186-9494-4e2f-a76c-bab3d7e27094 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:51.318298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-96528186-9494-4e2f-a76c-bab3d7e27094 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:51.327090 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-96528186-9494-4e2f-a76c-bab3d7e27094 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.151739 Aug 24 11:31:51.327196 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 340/669] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:51 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:52.347119 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4a912c25-e725-46f5-a83e-3f0682b094c5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:52.347726 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4a912c25-e725-46f5-a83e-3f0682b094c5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:52.354225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a912c25-e725-46f5-a83e-3f0682b094c5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:52.354710 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a912c25-e725-46f5-a83e-3f0682b094c5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:52.355148 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a912c25-e725-46f5-a83e-3f0682b094c5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:52.355833 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a912c25-e725-46f5-a83e-3f0682b094c5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:52.356288 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a912c25-e725-46f5-a83e-3f0682b094c5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:52.356711 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a912c25-e725-46f5-a83e-3f0682b094c5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:52.487967 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4a912c25-e725-46f5-a83e-3f0682b094c5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:52.496365 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4a912c25-e725-46f5-a83e-3f0682b094c5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1734 microversion: 2.1 time: 0.153001 Aug 24 11:31:52.501858 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 330/670] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:52 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:53.517649 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-40baa5eb-95cb-4a0b-b9c1-42a34e69eabe tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:53.518340 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-40baa5eb-95cb-4a0b-b9c1-42a34e69eabe tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:53.520753 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=39 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:53.525781 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40baa5eb-95cb-4a0b-b9c1-42a34e69eabe tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:53.526301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40baa5eb-95cb-4a0b-b9c1-42a34e69eabe tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:53.526740 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40baa5eb-95cb-4a0b-b9c1-42a34e69eabe tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:53.527436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40baa5eb-95cb-4a0b-b9c1-42a34e69eabe tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:53.527896 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40baa5eb-95cb-4a0b-b9c1-42a34e69eabe tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:53.528356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40baa5eb-95cb-4a0b-b9c1-42a34e69eabe tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:53.662983 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-40baa5eb-95cb-4a0b-b9c1-42a34e69eabe tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:53.671172 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-40baa5eb-95cb-4a0b-b9c1-42a34e69eabe tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1714 microversion: 2.1 time: 0.157403 Aug 24 11:31:53.671772 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 341/671] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:53 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:53.778535 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8f45d94f-8e60-4913-ba86-eef2bbeecd6b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:53.779053 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8f45d94f-8e60-4913-ba86-eef2bbeecd6b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:53.785523 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8f45d94f-8e60-4913-ba86-eef2bbeecd6b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:53.786102 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8f45d94f-8e60-4913-ba86-eef2bbeecd6b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:53.791623 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8f45d94f-8e60-4913-ba86-eef2bbeecd6b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:53.791623 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8f45d94f-8e60-4913-ba86-eef2bbeecd6b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:53.791623 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8f45d94f-8e60-4913-ba86-eef2bbeecd6b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:53.791623 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8f45d94f-8e60-4913-ba86-eef2bbeecd6b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:53.867326 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-8f45d94f-8e60-4913-ba86-eef2bbeecd6b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] HTTP exception thrown: Cannot 'detach_volume' instance c2aa046f-53cb-4392-9270-8f1d3b977f16 while it is in vm_state rescued Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8f45d94f-8e60-4913-ba86-eef2bbeecd6b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Request method failure captured: Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: DELETE /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments/68b5d87e-8649-4c53-b213-006af94cca73 HTTP/1.1 Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgsA8Jn_BUXkOSSf-IXqjq3ClFLYqNACLutdEq5Ij1NsviZ-h751UGnirP3f1ukDzGHkrgVXnxtFPib47w8CdDod3TnqCh2kVL57Xs2-fzXXISHIUuF_FZW58616j9CbFCbND1btJXqiSIS_4nJdx7k-0ePa33Pu5vyClvgN35VuW6o Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: e2a13f3ca60643a9a3507476325d351a Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:31:53.868988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:31:53.870401 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e2a13f3ca60643a9a3507476325d351a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:31:53.870401 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:31:53.870401 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: e2a13f3ca60643a9a3507476325d351a Aug 24 11:31:53.870401 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:31:53.870401 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-ServerRescueNegativeTestJSON-1136194767-project Aug 24 11:31:53.870401 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:31:53.870401 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:31:53.870401 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 57be68e76fc14d2ca309571e284509bd Aug 24 11:31:53.870401 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1136194767-project Aug 24 11:31:53.870401 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:31:53.870401 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Cannot 'detach_volume' instance c2aa046f-53cb-4392-9270-8f1d3b977f16 while it is in vm_state rescued Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'server_id': 'c2aa046f-53cb-4392-9270-8f1d3b977f16', 'id': '68b5d87e-8649-4c53-b213-006af94cca73'} Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c2aa046f-53cb-4392-9270-8f1d3b977f16 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:31:53.871123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c2aa046f-53cb-4392-9270-8f1d3b977f16 while it is in vm_state rescued Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c2aa046f-53cb-4392-9270-8f1d3b977f16 while it is in vm_state rescued Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:31:53.872639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8f45d94f-8e60-4913-ba86-eef2bbeecd6b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Returning 409 to user: Cannot 'detach_volume' instance c2aa046f-53cb-4392-9270-8f1d3b977f16 while it is in vm_state rescued {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:31:53.873803 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8f45d94f-8e60-4913-ba86-eef2bbeecd6b tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments/68b5d87e-8649-4c53-b213-006af94cca73" status: 409 len: 152 microversion: 2.1 time: 0.095869 Aug 24 11:31:53.873803 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 331/672] 10.222.0.83 () {58 vars in 1416 bytes} [Wed Aug 24 11:31:53 2022] DELETE /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments/68b5d87e-8649-4c53-b213-006af94cca73 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 11:31:53.879812 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-20cca8be-0883-4064-ac73-92db97d88c8d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:31:53.880372 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-20cca8be-0883-4064-ac73-92db97d88c8d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:53.886309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20cca8be-0883-4064-ac73-92db97d88c8d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:53.886798 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20cca8be-0883-4064-ac73-92db97d88c8d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:53.887235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20cca8be-0883-4064-ac73-92db97d88c8d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:53.887925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20cca8be-0883-4064-ac73-92db97d88c8d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:53.888379 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20cca8be-0883-4064-ac73-92db97d88c8d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:53.888802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20cca8be-0883-4064-ac73-92db97d88c8d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:54.133182 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-20cca8be-0883-4064-ac73-92db97d88c8d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "POST /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/action" status: 202 len: 0 microversion: 2.1 time: 0.257537 Aug 24 11:31:54.134019 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 342/673] 10.222.0.83 () {60 vars in 1278 bytes} [Wed Aug 24 11:31:53 2022] POST /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:31:54.142061 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-bc5b4999-62dc-43a4-869e-71d4cf0e4375 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:54.142674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-bc5b4999-62dc-43a4-869e-71d4cf0e4375 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:54.148929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bc5b4999-62dc-43a4-869e-71d4cf0e4375 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:54.149463 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bc5b4999-62dc-43a4-869e-71d4cf0e4375 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:54.149916 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bc5b4999-62dc-43a4-869e-71d4cf0e4375 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:54.150612 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bc5b4999-62dc-43a4-869e-71d4cf0e4375 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:54.151062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bc5b4999-62dc-43a4-869e-71d4cf0e4375 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:54.151505 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bc5b4999-62dc-43a4-869e-71d4cf0e4375 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:54.299612 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-bc5b4999-62dc-43a4-869e-71d4cf0e4375 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:54.308057 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-bc5b4999-62dc-43a4-869e-71d4cf0e4375 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1722 microversion: 2.1 time: 0.169911 Aug 24 11:31:54.308727 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 332/674] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:54 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:55.330362 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f9e02f3a-b6a8-4803-b020-ef1780cea4d5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:55.331072 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f9e02f3a-b6a8-4803-b020-ef1780cea4d5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:55.337168 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9e02f3a-b6a8-4803-b020-ef1780cea4d5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:55.337655 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9e02f3a-b6a8-4803-b020-ef1780cea4d5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:55.338119 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9e02f3a-b6a8-4803-b020-ef1780cea4d5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:55.338808 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9e02f3a-b6a8-4803-b020-ef1780cea4d5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:55.339267 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9e02f3a-b6a8-4803-b020-ef1780cea4d5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:55.339692 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9e02f3a-b6a8-4803-b020-ef1780cea4d5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:55.470869 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f9e02f3a-b6a8-4803-b020-ef1780cea4d5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:55.479773 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f9e02f3a-b6a8-4803-b020-ef1780cea4d5 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1722 microversion: 2.1 time: 0.154654 Aug 24 11:31:55.480389 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 343/675] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:55 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:56.508110 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-faac52f9-3b35-4e3d-9c2d-0b0ed718f128 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:56.508713 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-faac52f9-3b35-4e3d-9c2d-0b0ed718f128 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:56.515379 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-faac52f9-3b35-4e3d-9c2d-0b0ed718f128 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:56.515870 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-faac52f9-3b35-4e3d-9c2d-0b0ed718f128 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:56.516467 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-faac52f9-3b35-4e3d-9c2d-0b0ed718f128 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:56.517163 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-faac52f9-3b35-4e3d-9c2d-0b0ed718f128 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:56.517614 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-faac52f9-3b35-4e3d-9c2d-0b0ed718f128 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:56.518080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-faac52f9-3b35-4e3d-9c2d-0b0ed718f128 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:56.648320 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-faac52f9-3b35-4e3d-9c2d-0b0ed718f128 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:56.657612 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-faac52f9-3b35-4e3d-9c2d-0b0ed718f128 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1722 microversion: 2.1 time: 0.154031 Aug 24 11:31:56.658239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 333/676] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:56 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:57.731435 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a546c1b5-295a-4704-a386-43518875d8a0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:57.732080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a546c1b5-295a-4704-a386-43518875d8a0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:57.738109 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a546c1b5-295a-4704-a386-43518875d8a0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:57.738740 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a546c1b5-295a-4704-a386-43518875d8a0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:57.739176 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a546c1b5-295a-4704-a386-43518875d8a0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:57.739856 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a546c1b5-295a-4704-a386-43518875d8a0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:57.740307 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a546c1b5-295a-4704-a386-43518875d8a0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:57.740726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a546c1b5-295a-4704-a386-43518875d8a0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:57.868221 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a546c1b5-295a-4704-a386-43518875d8a0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:57.877115 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a546c1b5-295a-4704-a386-43518875d8a0 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1722 microversion: 2.1 time: 0.202409 Aug 24 11:31:57.877680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 344/677] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:57 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:58.901036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-654c6b76-d16f-4284-9540-71b38ee1ea90 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:58.901669 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-654c6b76-d16f-4284-9540-71b38ee1ea90 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:58.904170 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=45 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:31:58.909329 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-654c6b76-d16f-4284-9540-71b38ee1ea90 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:58.909821 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-654c6b76-d16f-4284-9540-71b38ee1ea90 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:58.910289 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-654c6b76-d16f-4284-9540-71b38ee1ea90 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:58.910987 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-654c6b76-d16f-4284-9540-71b38ee1ea90 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:58.911449 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-654c6b76-d16f-4284-9540-71b38ee1ea90 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:58.911873 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-654c6b76-d16f-4284-9540-71b38ee1ea90 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:59.046116 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-654c6b76-d16f-4284-9540-71b38ee1ea90 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:31:59.054815 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-654c6b76-d16f-4284-9540-71b38ee1ea90 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1728 microversion: 2.1 time: 0.158127 Aug 24 11:31:59.055374 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 334/678] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:31:58 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:31:59.075378 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cc12ac6b-49b8-4448-ba32-9f11fa467f52 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:31:59.075883 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cc12ac6b-49b8-4448-ba32-9f11fa467f52 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:31:59.082183 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc12ac6b-49b8-4448-ba32-9f11fa467f52 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:59.082667 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc12ac6b-49b8-4448-ba32-9f11fa467f52 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:59.083101 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc12ac6b-49b8-4448-ba32-9f11fa467f52 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:59.083780 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc12ac6b-49b8-4448-ba32-9f11fa467f52 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:31:59.084230 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc12ac6b-49b8-4448-ba32-9f11fa467f52 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:31:59.084645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc12ac6b-49b8-4448-ba32-9f11fa467f52 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:31:59.163546 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cc12ac6b-49b8-4448-ba32-9f11fa467f52 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091890 Aug 24 11:31:59.164144 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 345/679] 10.222.0.83 () {58 vars in 1275 bytes} [Wed Aug 24 11:31:59 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:00.336412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-ae456317-6e05-4149-9957-02d3fa902c98 req-0f1a7c6e-78f7-4d5a-9bc3-ead5c51b7724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2aa046f-53cb-4392-9270-8f1d3b977f16", "tag": "1cedc0c3-0dae-4b5b-88b5-558ae772865a"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:00.349007 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-ae456317-6e05-4149-9957-02d3fa902c98 req-0f1a7c6e-78f7-4d5a-9bc3-ead5c51b7724 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:00.349719 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-ae456317-6e05-4149-9957-02d3fa902c98 req-0f1a7c6e-78f7-4d5a-9bc3-ead5c51b7724 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:00.350261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-ae456317-6e05-4149-9957-02d3fa902c98 req-0f1a7c6e-78f7-4d5a-9bc3-ead5c51b7724 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:00.361510 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-ae456317-6e05-4149-9957-02d3fa902c98 req-0f1a7c6e-78f7-4d5a-9bc3-ead5c51b7724 service nova] Creating event network-changed:1cedc0c3-0dae-4b5b-88b5-558ae772865a for instance c2aa046f-53cb-4392-9270-8f1d3b977f16 on hv-cinder-85427 Aug 24 11:32:00.366822 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-ae456317-6e05-4149-9957-02d3fa902c98 req-0f1a7c6e-78f7-4d5a-9bc3-ead5c51b7724 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035065 Aug 24 11:32:00.367491 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 335/680] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:32:02.382141 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-6e5e2e51-0013-4ea2-a706-14ede268eb07 req-7c041510-e8ae-4487-b35b-75bf5bcd733d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2aa046f-53cb-4392-9270-8f1d3b977f16", "tag": "1cedc0c3-0dae-4b5b-88b5-558ae772865a"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:02.391678 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-6e5e2e51-0013-4ea2-a706-14ede268eb07 req-7c041510-e8ae-4487-b35b-75bf5bcd733d service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:02.392143 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-6e5e2e51-0013-4ea2-a706-14ede268eb07 req-7c041510-e8ae-4487-b35b-75bf5bcd733d service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:02.392563 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-6e5e2e51-0013-4ea2-a706-14ede268eb07 req-7c041510-e8ae-4487-b35b-75bf5bcd733d service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:02.403901 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-6e5e2e51-0013-4ea2-a706-14ede268eb07 req-7c041510-e8ae-4487-b35b-75bf5bcd733d service nova] Creating event network-changed:1cedc0c3-0dae-4b5b-88b5-558ae772865a for instance c2aa046f-53cb-4392-9270-8f1d3b977f16 on hv-cinder-85427 Aug 24 11:32:02.409329 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-6e5e2e51-0013-4ea2-a706-14ede268eb07 req-7c041510-e8ae-4487-b35b-75bf5bcd733d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031373 Aug 24 11:32:02.415470 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 346/681] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:06.514799 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-98471c69-0b34-4b9a-8b34-507b3e637923 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:06.517644 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-98471c69-0b34-4b9a-8b34-507b3e637923 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:06.524647 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-98471c69-0b34-4b9a-8b34-507b3e637923 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.525127 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-98471c69-0b34-4b9a-8b34-507b3e637923 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.525562 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-98471c69-0b34-4b9a-8b34-507b3e637923 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.526326 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-98471c69-0b34-4b9a-8b34-507b3e637923 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.526780 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-98471c69-0b34-4b9a-8b34-507b3e637923 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.527200 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-98471c69-0b34-4b9a-8b34-507b3e637923 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.734938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-98471c69-0b34-4b9a-8b34-507b3e637923 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "POST /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/action" status: 202 len: 0 microversion: 2.1 time: 0.224226 Aug 24 11:32:06.735556 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 336/682] 10.222.0.83 () {60 vars in 1278 bytes} [Wed Aug 24 11:32:06 2022] POST /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:32:06.744953 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0edc36f7-5131-4b6b-a1e6-ad08c4953d18 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:06.745654 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0edc36f7-5131-4b6b-a1e6-ad08c4953d18 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:06.752704 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0edc36f7-5131-4b6b-a1e6-ad08c4953d18 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.753191 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0edc36f7-5131-4b6b-a1e6-ad08c4953d18 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.753620 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0edc36f7-5131-4b6b-a1e6-ad08c4953d18 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.754339 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0edc36f7-5131-4b6b-a1e6-ad08c4953d18 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:06.754787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0edc36f7-5131-4b6b-a1e6-ad08c4953d18 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:06.755204 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0edc36f7-5131-4b6b-a1e6-ad08c4953d18 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:06.899190 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0edc36f7-5131-4b6b-a1e6-ad08c4953d18 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:06.907902 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0edc36f7-5131-4b6b-a1e6-ad08c4953d18 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1751 microversion: 2.1 time: 0.167930 Aug 24 11:32:06.908466 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 347/683] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:06 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:07.929825 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-37b6e965-d44b-43d8-93d1-49cabed8e268 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:07.930474 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-37b6e965-d44b-43d8-93d1-49cabed8e268 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:07.936728 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37b6e965-d44b-43d8-93d1-49cabed8e268 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:07.937204 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37b6e965-d44b-43d8-93d1-49cabed8e268 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:07.938177 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37b6e965-d44b-43d8-93d1-49cabed8e268 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:07.938861 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37b6e965-d44b-43d8-93d1-49cabed8e268 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:07.939302 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37b6e965-d44b-43d8-93d1-49cabed8e268 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:07.939715 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37b6e965-d44b-43d8-93d1-49cabed8e268 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:08.087200 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-37b6e965-d44b-43d8-93d1-49cabed8e268 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:08.095538 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-37b6e965-d44b-43d8-93d1-49cabed8e268 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1756 microversion: 2.1 time: 0.170618 Aug 24 11:32:08.096101 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 337/684] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:07 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:09.117763 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1c5312eb-02c4-47e3-8b12-eb35e3bd0218 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:09.118388 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1c5312eb-02c4-47e3-8b12-eb35e3bd0218 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:09.125058 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c5312eb-02c4-47e3-8b12-eb35e3bd0218 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.125546 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c5312eb-02c4-47e3-8b12-eb35e3bd0218 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.126021 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c5312eb-02c4-47e3-8b12-eb35e3bd0218 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.126724 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c5312eb-02c4-47e3-8b12-eb35e3bd0218 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:09.127182 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c5312eb-02c4-47e3-8b12-eb35e3bd0218 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:09.127606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c5312eb-02c4-47e3-8b12-eb35e3bd0218 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:09.274659 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1c5312eb-02c4-47e3-8b12-eb35e3bd0218 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:09.283090 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1c5312eb-02c4-47e3-8b12-eb35e3bd0218 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1756 microversion: 2.1 time: 0.169313 Aug 24 11:32:09.283674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 348/685] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:09 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:10.169752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-cfbb8dd9-272f-424b-9295-ee38a7e7f8c7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:10.170372 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-cfbb8dd9-272f-424b-9295-ee38a7e7f8c7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:10.176794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cfbb8dd9-272f-424b-9295-ee38a7e7f8c7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.177266 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cfbb8dd9-272f-424b-9295-ee38a7e7f8c7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.177692 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cfbb8dd9-272f-424b-9295-ee38a7e7f8c7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.178424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cfbb8dd9-272f-424b-9295-ee38a7e7f8c7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.178870 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cfbb8dd9-272f-424b-9295-ee38a7e7f8c7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.179277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cfbb8dd9-272f-424b-9295-ee38a7e7f8c7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.204796 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-cfbb8dd9-272f-424b-9295-ee38a7e7f8c7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7/ips" status: 200 len: 150 microversion: 2.1 time: 0.038989 Aug 24 11:32:10.205360 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 338/686] 10.222.0.83 () {58 vars in 1248 bytes} [Wed Aug 24 11:32:10 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:10.216499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0e48d795-4ca0-4a04-b431-1e134331d743 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b55bba1e-8387-46f6-be73-c48736710f5d"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:10.218853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0e48d795-4ca0-4a04-b431-1e134331d743 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:10.225126 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e48d795-4ca0-4a04-b431-1e134331d743 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.225606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e48d795-4ca0-4a04-b431-1e134331d743 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.226068 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e48d795-4ca0-4a04-b431-1e134331d743 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.226747 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e48d795-4ca0-4a04-b431-1e134331d743 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.227192 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e48d795-4ca0-4a04-b431-1e134331d743 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.227607 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e48d795-4ca0-4a04-b431-1e134331d743 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.303819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9774ccc5-d267-43b3-a9ea-ef8ab8d4474b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:10.304424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9774ccc5-d267-43b3-a9ea-ef8ab8d4474b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:10.307903 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-0e48d795-4ca0-4a04-b431-1e134331d743 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] HTTP exception thrown: Invalid volume: volume b55bba1e-8387-46f6-be73-c48736710f5d is already attached to instances: 855ac5ba-541c-4dc9-8a34-122679948e06 Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0e48d795-4ca0-4a04-b431-1e134331d743 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Request method failure captured: Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: POST /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7/os-volume_attachments HTTP/1.1 Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 74 Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgqETgNFLZN-cxtSDRr_AFoOlwFhwLX-ENYaVxJIHruplC9b_hdqfdtCiKQ8e38a_s-rndXFIgCY0GxucbSuzC9p3nENX8PLFIsqMQamCWy7Yc0bmYX9_A7TAaleaFSwaJqPHdkBljR5oJSERsZWj2B6SSpAFNzgXV0qWmNYC4EPrM8 Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:32:10.309850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:32:10.311351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6e41187605624091a4edc1993c4357e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6e41187605624091a4edc1993c4357e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:32:10.311351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:32:10.311351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:32:10.311351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:32:10.311351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:32:10.311351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:32:10.311351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:32:10.311351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 92712c36310c440c94da6c432c77a895 Aug 24 11:32:10.311351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:32:10.311351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Aug 24 11:32:10.311351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {"volumeAttachment": {"volumeId": "b55bba1e-8387-46f6-be73-c48736710f5d"}} Aug 24 11:32:10.311351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Invalid volume: volume b55bba1e-8387-46f6-be73-c48736710f5d is already attached to instances: 855ac5ba-541c-4dc9-8a34-122679948e06 Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'server_id': '52c2009e-3a3a-4e95-a967-0275cb1fe2b7', 'body': {'volumeAttachment': {'volumeId': 'b55bba1e-8387-46f6-be73-c48736710f5d'}}} Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b55bba1e-8387-46f6-be73-c48736710f5d is already attached to instances: 855ac5ba-541c-4dc9-8a34-122679948e06 Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:32:10.313098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b55bba1e-8387-46f6-be73-c48736710f5d is already attached to instances: 855ac5ba-541c-4dc9-8a34-122679948e06 Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:10.314601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:10.316941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:10.316941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:32:10.316941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:32:10.316941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b55bba1e-8387-46f6-be73-c48736710f5d is already attached to instances: 855ac5ba-541c-4dc9-8a34-122679948e06 Aug 24 11:32:10.316941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:32:10.316941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0e48d795-4ca0-4a04-b431-1e134331d743 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Returning 400 to user: Invalid volume: volume b55bba1e-8387-46f6-be73-c48736710f5d is already attached to instances: 855ac5ba-541c-4dc9-8a34-122679948e06 {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:32:10.318977 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9774ccc5-d267-43b3-a9ea-ef8ab8d4474b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.318977 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9774ccc5-d267-43b3-a9ea-ef8ab8d4474b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.319181 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0e48d795-4ca0-4a04-b431-1e134331d743 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "POST /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098733 Aug 24 11:32:10.319286 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9774ccc5-d267-43b3-a9ea-ef8ab8d4474b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.319384 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 349/687] 10.222.0.83 () {60 vars in 1323 bytes} [Wed Aug 24 11:32:10 2022] POST /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:32:10.319478 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9774ccc5-d267-43b3-a9ea-ef8ab8d4474b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.319478 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9774ccc5-d267-43b3-a9ea-ef8ab8d4474b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.319478 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9774ccc5-d267-43b3-a9ea-ef8ab8d4474b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.320718 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9ae39147-e667-4a85-a2dc-0b2b6dbedf39 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:10.321116 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9ae39147-e667-4a85-a2dc-0b2b6dbedf39 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:10.328169 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ae39147-e667-4a85-a2dc-0b2b6dbedf39 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.328930 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ae39147-e667-4a85-a2dc-0b2b6dbedf39 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.329063 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ae39147-e667-4a85-a2dc-0b2b6dbedf39 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.329749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ae39147-e667-4a85-a2dc-0b2b6dbedf39 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.330375 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ae39147-e667-4a85-a2dc-0b2b6dbedf39 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.330644 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ae39147-e667-4a85-a2dc-0b2b6dbedf39 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.355639 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9ae39147-e667-4a85-a2dc-0b2b6dbedf39 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:32:10.390690 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:10.461092 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9774ccc5-d267-43b3-a9ea-ef8ab8d4474b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.469665 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9774ccc5-d267-43b3-a9ea-ef8ab8d4474b tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1756 microversion: 2.1 time: 0.169632 Aug 24 11:32:10.470264 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 339/688] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:10 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:10.719719 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9ae39147-e667-4a85-a2dc-0b2b6dbedf39 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 204 len: 0 microversion: 2.1 time: 0.401891 Aug 24 11:32:10.720225 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 350/689] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:32:10 2022] DELETE /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:32:10.728576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1609ec9a-2e91-4117-b1c6-07f366a958d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:10.729198 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1609ec9a-2e91-4117-b1c6-07f366a958d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:10.735997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1609ec9a-2e91-4117-b1c6-07f366a958d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.743156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1609ec9a-2e91-4117-b1c6-07f366a958d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.743156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1609ec9a-2e91-4117-b1c6-07f366a958d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.743156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1609ec9a-2e91-4117-b1c6-07f366a958d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:10.743156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1609ec9a-2e91-4117-b1c6-07f366a958d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:10.743566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1609ec9a-2e91-4117-b1c6-07f366a958d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:10.867812 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1609ec9a-2e91-4117-b1c6-07f366a958d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:10.875487 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1609ec9a-2e91-4117-b1c6-07f366a958d0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1680 microversion: 2.1 time: 0.150834 Aug 24 11:32:10.876047 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 340/690] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:10 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:11.491978 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6a91e373-42ce-4561-b840-955760c116c8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:11.492678 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6a91e373-42ce-4561-b840-955760c116c8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:11.499213 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a91e373-42ce-4561-b840-955760c116c8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.499695 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a91e373-42ce-4561-b840-955760c116c8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.500129 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a91e373-42ce-4561-b840-955760c116c8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.500813 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a91e373-42ce-4561-b840-955760c116c8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.501446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a91e373-42ce-4561-b840-955760c116c8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.501890 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a91e373-42ce-4561-b840-955760c116c8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.647552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6a91e373-42ce-4561-b840-955760c116c8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:11.657126 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6a91e373-42ce-4561-b840-955760c116c8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1756 microversion: 2.1 time: 0.169369 Aug 24 11:32:11.659781 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 351/691] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:11 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:11.896947 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-aac0ff76-0b55-4241-9db0-b16862e04db3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:11.897656 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-aac0ff76-0b55-4241-9db0-b16862e04db3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:11.904146 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aac0ff76-0b55-4241-9db0-b16862e04db3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.904631 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aac0ff76-0b55-4241-9db0-b16862e04db3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.905069 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aac0ff76-0b55-4241-9db0-b16862e04db3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:11.905758 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aac0ff76-0b55-4241-9db0-b16862e04db3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:11.906813 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aac0ff76-0b55-4241-9db0-b16862e04db3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:11.907234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aac0ff76-0b55-4241-9db0-b16862e04db3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.040140 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-aac0ff76-0b55-4241-9db0-b16862e04db3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:12.048140 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-aac0ff76-0b55-4241-9db0-b16862e04db3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1680 microversion: 2.1 time: 0.155354 Aug 24 11:32:12.048703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 341/692] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:11 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:12.678464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-01dcc854-4eb2-4091-89f4-a1dfebd72b3c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:12.679132 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-01dcc854-4eb2-4091-89f4-a1dfebd72b3c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:12.685587 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01dcc854-4eb2-4091-89f4-a1dfebd72b3c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.686118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01dcc854-4eb2-4091-89f4-a1dfebd72b3c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.686551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01dcc854-4eb2-4091-89f4-a1dfebd72b3c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.687243 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01dcc854-4eb2-4091-89f4-a1dfebd72b3c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:12.687692 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01dcc854-4eb2-4091-89f4-a1dfebd72b3c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:12.688126 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01dcc854-4eb2-4091-89f4-a1dfebd72b3c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:12.839157 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-01dcc854-4eb2-4091-89f4-a1dfebd72b3c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:12.847993 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-01dcc854-4eb2-4091-89f4-a1dfebd72b3c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1756 microversion: 2.1 time: 0.173532 Aug 24 11:32:12.848638 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 352/693] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:12 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:13.069309 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4d4e4e73-cef7-4cf1-9880-51036bdcbc76 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:13.069923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4d4e4e73-cef7-4cf1-9880-51036bdcbc76 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:13.076377 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4d4e4e73-cef7-4cf1-9880-51036bdcbc76 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.076853 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4d4e4e73-cef7-4cf1-9880-51036bdcbc76 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.077281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4d4e4e73-cef7-4cf1-9880-51036bdcbc76 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.078564 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4d4e4e73-cef7-4cf1-9880-51036bdcbc76 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.079011 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4d4e4e73-cef7-4cf1-9880-51036bdcbc76 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.079425 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4d4e4e73-cef7-4cf1-9880-51036bdcbc76 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.097677 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:13.209922 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4d4e4e73-cef7-4cf1-9880-51036bdcbc76 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:13.216071 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4d4e4e73-cef7-4cf1-9880-51036bdcbc76 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1680 microversion: 2.1 time: 0.150573 Aug 24 11:32:13.216838 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 342/694] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:13 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:13.868682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-91e71a76-efc2-47b6-a4a8-a1d6428198d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:13.869326 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-91e71a76-efc2-47b6-a4a8-a1d6428198d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:13.876853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91e71a76-efc2-47b6-a4a8-a1d6428198d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.877302 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91e71a76-efc2-47b6-a4a8-a1d6428198d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.877742 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91e71a76-efc2-47b6-a4a8-a1d6428198d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:13.878525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91e71a76-efc2-47b6-a4a8-a1d6428198d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:13.879025 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91e71a76-efc2-47b6-a4a8-a1d6428198d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:13.879453 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91e71a76-efc2-47b6-a4a8-a1d6428198d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.022454 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-91e71a76-efc2-47b6-a4a8-a1d6428198d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:14.030791 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-91e71a76-efc2-47b6-a4a8-a1d6428198d7 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1756 microversion: 2.1 time: 0.166055 Aug 24 11:32:14.031364 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 353/695] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:13 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:14.237862 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4e181785-bd62-40c7-b993-039d448bf097 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:14.238477 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4e181785-bd62-40c7-b993-039d448bf097 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:14.246586 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4e181785-bd62-40c7-b993-039d448bf097 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.247541 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4e181785-bd62-40c7-b993-039d448bf097 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.248221 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4e181785-bd62-40c7-b993-039d448bf097 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.251275 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4e181785-bd62-40c7-b993-039d448bf097 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.252273 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4e181785-bd62-40c7-b993-039d448bf097 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.252862 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4e181785-bd62-40c7-b993-039d448bf097 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.348612 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4e181785-bd62-40c7-b993-039d448bf097 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:14.357159 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4e181785-bd62-40c7-b993-039d448bf097 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1613 microversion: 2.1 time: 0.123622 Aug 24 11:32:14.358015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 343/696] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:14 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1613 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:14.452512 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-870db741-7537-47a4-ae00-2cf0a155c427 req-f5b75460-9537-4cf4-abbe-613bb4f4e341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c2009e-3a3a-4e95-a967-0275cb1fe2b7", "name": "network-vif-deleted", "tag": "bfbbb09f-cfde-48f3-8c4e-dff38fe58e8d"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:14.467878 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-870db741-7537-47a4-ae00-2cf0a155c427 req-f5b75460-9537-4cf4-abbe-613bb4f4e341 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:14.468941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-870db741-7537-47a4-ae00-2cf0a155c427 req-f5b75460-9537-4cf4-abbe-613bb4f4e341 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:14.470273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-870db741-7537-47a4-ae00-2cf0a155c427 req-f5b75460-9537-4cf4-abbe-613bb4f4e341 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:14.481933 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-870db741-7537-47a4-ae00-2cf0a155c427 req-f5b75460-9537-4cf4-abbe-613bb4f4e341 service nova] Creating event network-vif-deleted:bfbbb09f-cfde-48f3-8c4e-dff38fe58e8d for instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 on hv-cinder-85427 Aug 24 11:32:14.488154 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-870db741-7537-47a4-ae00-2cf0a155c427 req-f5b75460-9537-4cf4-abbe-613bb4f4e341 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041386 Aug 24 11:32:14.488887 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 354/697] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:15.052554 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5e0efe64-a2ab-4e45-9da0-9f75742c9572 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:15.053195 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5e0efe64-a2ab-4e45-9da0-9f75742c9572 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:15.059793 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5e0efe64-a2ab-4e45-9da0-9f75742c9572 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.060283 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5e0efe64-a2ab-4e45-9da0-9f75742c9572 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.060951 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5e0efe64-a2ab-4e45-9da0-9f75742c9572 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.061676 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5e0efe64-a2ab-4e45-9da0-9f75742c9572 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.062164 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5e0efe64-a2ab-4e45-9da0-9f75742c9572 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.062579 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5e0efe64-a2ab-4e45-9da0-9f75742c9572 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.230988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5e0efe64-a2ab-4e45-9da0-9f75742c9572 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:15.240296 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5e0efe64-a2ab-4e45-9da0-9f75742c9572 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1756 microversion: 2.1 time: 0.191897 Aug 24 11:32:15.241339 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 344/698] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:15 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:15.381120 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-28844dcc-64ad-449b-ab18-48a30d29f98c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:15.381903 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-28844dcc-64ad-449b-ab18-48a30d29f98c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:15.389170 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28844dcc-64ad-449b-ab18-48a30d29f98c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.389889 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28844dcc-64ad-449b-ab18-48a30d29f98c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.390910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28844dcc-64ad-449b-ab18-48a30d29f98c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.391633 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28844dcc-64ad-449b-ab18-48a30d29f98c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.392093 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28844dcc-64ad-449b-ab18-48a30d29f98c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.392524 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28844dcc-64ad-449b-ab18-48a30d29f98c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.430445 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28844dcc-64ad-449b-ab18-48a30d29f98c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:15.430930 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28844dcc-64ad-449b-ab18-48a30d29f98c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:15.431368 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28844dcc-64ad-449b-ab18-48a30d29f98c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:15.431834 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-28844dcc-64ad-449b-ab18-48a30d29f98c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lazy-loading 'fault' on Instance uuid 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:32:15.492348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-28844dcc-64ad-449b-ab18-48a30d29f98c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:15.502567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-28844dcc-64ad-449b-ab18-48a30d29f98c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 200 len: 1330 microversion: 2.1 time: 0.125805 Aug 24 11:32:15.503545 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 355/699] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:15 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 1330 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:16.262291 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c6b346ac-4a3d-438b-a5d1-092c0b2c28e6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:16.262823 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c6b346ac-4a3d-438b-a5d1-092c0b2c28e6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:16.269802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6b346ac-4a3d-438b-a5d1-092c0b2c28e6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.270579 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6b346ac-4a3d-438b-a5d1-092c0b2c28e6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.271018 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6b346ac-4a3d-438b-a5d1-092c0b2c28e6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.271715 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6b346ac-4a3d-438b-a5d1-092c0b2c28e6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.272167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6b346ac-4a3d-438b-a5d1-092c0b2c28e6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.272589 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6b346ac-4a3d-438b-a5d1-092c0b2c28e6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.421758 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c6b346ac-4a3d-438b-a5d1-092c0b2c28e6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:16.431603 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c6b346ac-4a3d-438b-a5d1-092c0b2c28e6 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1756 microversion: 2.1 time: 0.173241 Aug 24 11:32:16.433183 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 345/700] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:16 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:16.524318 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7167b652-2f1c-4f74-8062-73d9d758962a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:16.524871 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7167b652-2f1c-4f74-8062-73d9d758962a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:16.531408 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7167b652-2f1c-4f74-8062-73d9d758962a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.542286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7167b652-2f1c-4f74-8062-73d9d758962a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.542286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7167b652-2f1c-4f74-8062-73d9d758962a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.542286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7167b652-2f1c-4f74-8062-73d9d758962a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:16.542286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7167b652-2f1c-4f74-8062-73d9d758962a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:16.542641 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7167b652-2f1c-4f74-8062-73d9d758962a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:16.547436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-7167b652-2f1c-4f74-8062-73d9d758962a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] HTTP exception thrown: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7167b652-2f1c-4f74-8062-73d9d758962a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Request method failure captured: Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 HTTP/1.1 Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgqETgNFLZN-cxtSDRr_AFoOlwFhwLX-ENYaVxJIHruplC9b_hdqfdtCiKQ8e38a_s-rndXFIgCY0GxucbSuzC9p3nENX8PLFIsqMQamCWy7Yc0bmYX9_A7TAaleaFSwaJqPHdkBljR5oJSERsZWj2B6SSpAFNzgXV0qWmNYC4EPrM8 Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:32:16.549055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:32:16.550578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6e41187605624091a4edc1993c4357e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6e41187605624091a4edc1993c4357e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:32:16.550578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:32:16.550578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:32:16.550578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:32:16.550578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:32:16.550578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:32:16.550578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:32:16.550578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 92712c36310c440c94da6c432c77a895 Aug 24 11:32:16.550578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:32:16.550578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:32:16.550578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:32:16.550578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '52c2009e-3a3a-4e95-a967-0275cb1fe2b7'} Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:32:16.551451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:32:16.552725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:32:16.554025 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7167b652-2f1c-4f74-8062-73d9d758962a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Returning 404 to user: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:32:16.554025 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7167b652-2f1c-4f74-8062-73d9d758962a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 404 len: 111 microversion: 2.1 time: 0.030381 Aug 24 11:32:16.554025 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 356/701] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:16 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:32:16.559427 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8084198f-5139-4659-a242-dadcce9207ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '.version_select at 0x7f723cf5ba60>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:16.656110 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8084198f-5139-4659-a242-dadcce9207ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-162066702" status: 202 len: 0 microversion: 2.1 time: 0.099956 Aug 24 11:32:16.656612 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 346/702] 10.222.0.83 () {58 vars in 1218 bytes} [Wed Aug 24 11:32:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-162066702 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:32:17.452499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e5091713-d0ed-4ef2-8e6d-88b15962aec3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:17.453891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e5091713-d0ed-4ef2-8e6d-88b15962aec3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:17.460219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5091713-d0ed-4ef2-8e6d-88b15962aec3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.460710 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5091713-d0ed-4ef2-8e6d-88b15962aec3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.461152 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5091713-d0ed-4ef2-8e6d-88b15962aec3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.461847 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5091713-d0ed-4ef2-8e6d-88b15962aec3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.462331 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5091713-d0ed-4ef2-8e6d-88b15962aec3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.462916 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5091713-d0ed-4ef2-8e6d-88b15962aec3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.469130 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d1b6bc4a-a20a-4a95-a3cf-ce1cefba9da5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:17.469670 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d1b6bc4a-a20a-4a95-a3cf-ce1cefba9da5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:17.476714 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d1b6bc4a-a20a-4a95-a3cf-ce1cefba9da5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.477225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d1b6bc4a-a20a-4a95-a3cf-ce1cefba9da5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.477746 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d1b6bc4a-a20a-4a95-a3cf-ce1cefba9da5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.478537 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d1b6bc4a-a20a-4a95-a3cf-ce1cefba9da5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.479058 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d1b6bc4a-a20a-4a95-a3cf-ce1cefba9da5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.479554 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d1b6bc4a-a20a-4a95-a3cf-ce1cefba9da5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.566543 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-d1b6bc4a-a20a-4a95-a3cf-ce1cefba9da5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lazy-loading 'services' on Instance uuid 855ac5ba-541c-4dc9-8a34-122679948e06 {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:32:17.610166 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e5091713-d0ed-4ef2-8e6d-88b15962aec3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:17.618365 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e5091713-d0ed-4ef2-8e6d-88b15962aec3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1756 microversion: 2.1 time: 0.169671 Aug 24 11:32:17.618929 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 357/703] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:17 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:17.786906 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d1b6bc4a-a20a-4a95-a3cf-ce1cefba9da5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06/os-volume_attachments/b55bba1e-8387-46f6-be73-c48736710f5d" status: 202 len: 0 microversion: 2.1 time: 0.322020 Aug 24 11:32:17.787496 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 347/704] 10.222.0.83 () {58 vars in 1416 bytes} [Wed Aug 24 11:32:17 2022] DELETE /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06/os-volume_attachments/b55bba1e-8387-46f6-be73-c48736710f5d => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:32:17.795965 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a45a94d2-a750-4fb2-81d6-8daade99fbef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:17.798786 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a45a94d2-a750-4fb2-81d6-8daade99fbef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:17.804823 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a45a94d2-a750-4fb2-81d6-8daade99fbef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.805311 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a45a94d2-a750-4fb2-81d6-8daade99fbef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.805728 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a45a94d2-a750-4fb2-81d6-8daade99fbef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.806451 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a45a94d2-a750-4fb2-81d6-8daade99fbef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:17.806899 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a45a94d2-a750-4fb2-81d6-8daade99fbef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:17.810305 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a45a94d2-a750-4fb2-81d6-8daade99fbef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:17.838135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a45a94d2-a750-4fb2-81d6-8daade99fbef tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 Aug 24 11:32:17.838958 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 358/705] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:32:17 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:32:18.641647 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e5ea4ea0-3d0d-4fab-8ce3-5ca9b2ff0a93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:18.642305 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e5ea4ea0-3d0d-4fab-8ce3-5ca9b2ff0a93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:18.648786 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e5ea4ea0-3d0d-4fab-8ce3-5ca9b2ff0a93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.649268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e5ea4ea0-3d0d-4fab-8ce3-5ca9b2ff0a93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.649701 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e5ea4ea0-3d0d-4fab-8ce3-5ca9b2ff0a93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.650432 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e5ea4ea0-3d0d-4fab-8ce3-5ca9b2ff0a93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.651010 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e5ea4ea0-3d0d-4fab-8ce3-5ca9b2ff0a93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.651463 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e5ea4ea0-3d0d-4fab-8ce3-5ca9b2ff0a93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.801645 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e5ea4ea0-3d0d-4fab-8ce3-5ca9b2ff0a93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:18.810018 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e5ea4ea0-3d0d-4fab-8ce3-5ca9b2ff0a93 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1756 microversion: 2.1 time: 0.173707 Aug 24 11:32:18.810566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 348/706] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:18 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:18.850787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9c29fa95-f419-4e47-8e0a-1225faecb257 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:18.852941 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9c29fa95-f419-4e47-8e0a-1225faecb257 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:18.859445 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c29fa95-f419-4e47-8e0a-1225faecb257 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.859933 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c29fa95-f419-4e47-8e0a-1225faecb257 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.860398 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c29fa95-f419-4e47-8e0a-1225faecb257 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.861097 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c29fa95-f419-4e47-8e0a-1225faecb257 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:18.861552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c29fa95-f419-4e47-8e0a-1225faecb257 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:18.862021 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c29fa95-f419-4e47-8e0a-1225faecb257 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:18.891158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9c29fa95-f419-4e47-8e0a-1225faecb257 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Aug 24 11:32:18.891761 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 359/707] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:32:18 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:19.832229 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1e9f7973-3682-4403-97d0-b03ba1e47687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:19.833532 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1e9f7973-3682-4403-97d0-b03ba1e47687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:19.840173 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1e9f7973-3682-4403-97d0-b03ba1e47687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.840820 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1e9f7973-3682-4403-97d0-b03ba1e47687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.841377 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1e9f7973-3682-4403-97d0-b03ba1e47687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.841759 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1e9f7973-3682-4403-97d0-b03ba1e47687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.842242 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1e9f7973-3682-4403-97d0-b03ba1e47687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.842665 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1e9f7973-3682-4403-97d0-b03ba1e47687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.903774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-82314bf9-f008-4c22-bca1-6ce6ad922fa7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:19.906069 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-82314bf9-f008-4c22-bca1-6ce6ad922fa7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:19.912886 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82314bf9-f008-4c22-bca1-6ce6ad922fa7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.913401 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82314bf9-f008-4c22-bca1-6ce6ad922fa7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.913849 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82314bf9-f008-4c22-bca1-6ce6ad922fa7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.914591 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82314bf9-f008-4c22-bca1-6ce6ad922fa7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:19.915048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82314bf9-f008-4c22-bca1-6ce6ad922fa7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:19.915474 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82314bf9-f008-4c22-bca1-6ce6ad922fa7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:19.945864 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-82314bf9-f008-4c22-bca1-6ce6ad922fa7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046225 Aug 24 11:32:19.946476 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 360/708] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:32:19 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 11:32:19.990960 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1e9f7973-3682-4403-97d0-b03ba1e47687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:20.000137 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1e9f7973-3682-4403-97d0-b03ba1e47687 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1756 microversion: 2.1 time: 0.171363 Aug 24 11:32:20.000706 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 349/709] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:19 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:20.010327 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3daf98f4-d80c-4ed9-9018-852684c096dc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:20.014081 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3daf98f4-d80c-4ed9-9018-852684c096dc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:20.017227 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3daf98f4-d80c-4ed9-9018-852684c096dc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.017716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3daf98f4-d80c-4ed9-9018-852684c096dc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.018197 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3daf98f4-d80c-4ed9-9018-852684c096dc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.018898 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3daf98f4-d80c-4ed9-9018-852684c096dc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.019380 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3daf98f4-d80c-4ed9-9018-852684c096dc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.019807 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3daf98f4-d80c-4ed9-9018-852684c096dc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.044871 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3daf98f4-d80c-4ed9-9018-852684c096dc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:32:20.375722 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3daf98f4-d80c-4ed9-9018-852684c096dc tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 204 len: 0 microversion: 2.1 time: 0.368861 Aug 24 11:32:20.376326 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 361/710] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:32:20 2022] DELETE /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:20.384770 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b0c1128f-d896-47f2-b544-e51579a20b13 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:20.385380 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b0c1128f-d896-47f2-b544-e51579a20b13 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:20.392166 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0c1128f-d896-47f2-b544-e51579a20b13 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.392654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0c1128f-d896-47f2-b544-e51579a20b13 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.393092 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0c1128f-d896-47f2-b544-e51579a20b13 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.393784 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0c1128f-d896-47f2-b544-e51579a20b13 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:20.394279 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0c1128f-d896-47f2-b544-e51579a20b13 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:20.394703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0c1128f-d896-47f2-b544-e51579a20b13 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:20.524160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b0c1128f-d896-47f2-b544-e51579a20b13 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:20.533404 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b0c1128f-d896-47f2-b544-e51579a20b13 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1681 microversion: 2.1 time: 0.152774 Aug 24 11:32:20.534002 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 350/711] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:20 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:21.022717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7d45d331-8938-461d-934f-212cf21ddbda tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:21.023424 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7d45d331-8938-461d-934f-212cf21ddbda tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:21.029887 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7d45d331-8938-461d-934f-212cf21ddbda tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.030474 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7d45d331-8938-461d-934f-212cf21ddbda tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.030910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7d45d331-8938-461d-934f-212cf21ddbda tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.031601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7d45d331-8938-461d-934f-212cf21ddbda tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.032050 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7d45d331-8938-461d-934f-212cf21ddbda tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.032475 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7d45d331-8938-461d-934f-212cf21ddbda tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.197738 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7d45d331-8938-461d-934f-212cf21ddbda tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:21.206693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7d45d331-8938-461d-934f-212cf21ddbda tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1756 microversion: 2.1 time: 0.189003 Aug 24 11:32:21.207251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 362/712] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:21 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:21.554813 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ee80186b-6d82-4e99-a30e-7ad12dd0f9c5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:21.555444 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ee80186b-6d82-4e99-a30e-7ad12dd0f9c5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:21.562444 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ee80186b-6d82-4e99-a30e-7ad12dd0f9c5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.562932 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ee80186b-6d82-4e99-a30e-7ad12dd0f9c5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.563361 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ee80186b-6d82-4e99-a30e-7ad12dd0f9c5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.564045 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ee80186b-6d82-4e99-a30e-7ad12dd0f9c5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:21.564493 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ee80186b-6d82-4e99-a30e-7ad12dd0f9c5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:21.564914 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ee80186b-6d82-4e99-a30e-7ad12dd0f9c5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:21.693908 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ee80186b-6d82-4e99-a30e-7ad12dd0f9c5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:21.701605 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ee80186b-6d82-4e99-a30e-7ad12dd0f9c5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1681 microversion: 2.1 time: 0.150639 Aug 24 11:32:21.702213 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 351/713] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:21 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:22.227538 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5ebd740b-d098-482a-8a76-cdfe0bb01f0f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:22.228153 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5ebd740b-d098-482a-8a76-cdfe0bb01f0f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:22.234974 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ebd740b-d098-482a-8a76-cdfe0bb01f0f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.235460 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ebd740b-d098-482a-8a76-cdfe0bb01f0f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.235898 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ebd740b-d098-482a-8a76-cdfe0bb01f0f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.236596 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ebd740b-d098-482a-8a76-cdfe0bb01f0f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.237062 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ebd740b-d098-482a-8a76-cdfe0bb01f0f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.237474 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ebd740b-d098-482a-8a76-cdfe0bb01f0f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.352138 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5038e4b6-8b63-4802-9374-207e48f58993 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:22.352763 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5038e4b6-8b63-4802-9374-207e48f58993 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:22.358753 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5038e4b6-8b63-4802-9374-207e48f58993 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.359311 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5038e4b6-8b63-4802-9374-207e48f58993 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.359744 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5038e4b6-8b63-4802-9374-207e48f58993 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.360432 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5038e4b6-8b63-4802-9374-207e48f58993 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.360970 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5038e4b6-8b63-4802-9374-207e48f58993 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.361390 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5038e4b6-8b63-4802-9374-207e48f58993 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.383986 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5ebd740b-d098-482a-8a76-cdfe0bb01f0f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:22.385041 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-5038e4b6-8b63-4802-9374-207e48f58993 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lazy-loading 'flavor' on Instance uuid a9b6e400-1d49-417d-9140-692da71f9da6 {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:32:22.393066 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5ebd740b-d098-482a-8a76-cdfe0bb01f0f tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1756 microversion: 2.1 time: 0.169269 Aug 24 11:32:22.393740 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 363/714] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:22 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:22.722780 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c49f368a-c6be-4b15-97c5-1f032712b083 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:22.723348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c49f368a-c6be-4b15-97c5-1f032712b083 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:22.729839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c49f368a-c6be-4b15-97c5-1f032712b083 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.735005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c49f368a-c6be-4b15-97c5-1f032712b083 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.735005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c49f368a-c6be-4b15-97c5-1f032712b083 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.735005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c49f368a-c6be-4b15-97c5-1f032712b083 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.735005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c49f368a-c6be-4b15-97c5-1f032712b083 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.735996 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c49f368a-c6be-4b15-97c5-1f032712b083 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.798905 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c49f368a-c6be-4b15-97c5-1f032712b083 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:22.807105 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c49f368a-c6be-4b15-97c5-1f032712b083 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1614 microversion: 2.1 time: 0.088311 Aug 24 11:32:22.807677 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 364/715] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:22 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1614 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:22.812812 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-90db38de-cbab-4f8d-a814-816f3f94f000 req-c33b2065-4262-420c-b578-e8e7d86d8c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "855ac5ba-541c-4dc9-8a34-122679948e06", "name": "network-vif-deleted", "tag": "8a3e4fbb-fe41-4624-9e7f-cbd92817419e"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:22.823821 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-90db38de-cbab-4f8d-a814-816f3f94f000 req-c33b2065-4262-420c-b578-e8e7d86d8c69 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.824445 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-90db38de-cbab-4f8d-a814-816f3f94f000 req-c33b2065-4262-420c-b578-e8e7d86d8c69 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.824877 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-90db38de-cbab-4f8d-a814-816f3f94f000 req-c33b2065-4262-420c-b578-e8e7d86d8c69 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.837193 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-90db38de-cbab-4f8d-a814-816f3f94f000 req-c33b2065-4262-420c-b578-e8e7d86d8c69 service nova] Creating event network-vif-deleted:8a3e4fbb-fe41-4624-9e7f-cbd92817419e for instance 855ac5ba-541c-4dc9-8a34-122679948e06 on hv-cinder-85427 Aug 24 11:32:22.842561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-90db38de-cbab-4f8d-a814-816f3f94f000 req-c33b2065-4262-420c-b578-e8e7d86d8c69 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033504 Aug 24 11:32:22.843294 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 365/716] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:22.896054 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5038e4b6-8b63-4802-9374-207e48f58993 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "POST /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6/action" status: 202 len: 0 microversion: 2.1 time: 0.547760 Aug 24 11:32:22.897688 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 352/717] 10.222.0.83 () {60 vars in 1278 bytes} [Wed Aug 24 11:32:22 2022] POST /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:32:22.906901 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7385e6f8-c739-4512-b231-876c3f444087 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:22.907621 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7385e6f8-c739-4512-b231-876c3f444087 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:22.914177 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7385e6f8-c739-4512-b231-876c3f444087 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.915016 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7385e6f8-c739-4512-b231-876c3f444087 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.915620 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7385e6f8-c739-4512-b231-876c3f444087 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:22.916843 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7385e6f8-c739-4512-b231-876c3f444087 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:22.917466 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7385e6f8-c739-4512-b231-876c3f444087 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:22.918086 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7385e6f8-c739-4512-b231-876c3f444087 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.064030 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7385e6f8-c739-4512-b231-876c3f444087 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:23.067661 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:23.072326 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7385e6f8-c739-4512-b231-876c3f444087 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.170460 Aug 24 11:32:23.072908 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 366/718] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:22 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:23.416182 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8626c1ec-5b6a-479d-908d-33fe79c44d4e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:23.417026 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8626c1ec-5b6a-479d-908d-33fe79c44d4e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:23.424334 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8626c1ec-5b6a-479d-908d-33fe79c44d4e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.424823 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8626c1ec-5b6a-479d-908d-33fe79c44d4e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.425286 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8626c1ec-5b6a-479d-908d-33fe79c44d4e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.426002 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8626c1ec-5b6a-479d-908d-33fe79c44d4e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.426462 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8626c1ec-5b6a-479d-908d-33fe79c44d4e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.426868 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8626c1ec-5b6a-479d-908d-33fe79c44d4e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.582291 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8626c1ec-5b6a-479d-908d-33fe79c44d4e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:23.591357 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8626c1ec-5b6a-479d-908d-33fe79c44d4e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1756 microversion: 2.1 time: 0.179478 Aug 24 11:32:23.592320 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 353/719] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:23 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:23.831366 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-316bb994-a8e8-4377-ac45-067062b149ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:23.831982 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-316bb994-a8e8-4377-ac45-067062b149ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:23.834222 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:23.839229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-316bb994-a8e8-4377-ac45-067062b149ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.839747 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-316bb994-a8e8-4377-ac45-067062b149ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.840186 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-316bb994-a8e8-4377-ac45-067062b149ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.840874 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-316bb994-a8e8-4377-ac45-067062b149ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.841319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-316bb994-a8e8-4377-ac45-067062b149ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.841739 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-316bb994-a8e8-4377-ac45-067062b149ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.873560 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-316bb994-a8e8-4377-ac45-067062b149ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:23.874535 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-316bb994-a8e8-4377-ac45-067062b149ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:23.874535 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-316bb994-a8e8-4377-ac45-067062b149ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:23.874955 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-316bb994-a8e8-4377-ac45-067062b149ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lazy-loading 'fault' on Instance uuid 855ac5ba-541c-4dc9-8a34-122679948e06 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:32:23.920135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-316bb994-a8e8-4377-ac45-067062b149ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:23.926126 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-316bb994-a8e8-4377-ac45-067062b149ff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 200 len: 1331 microversion: 2.1 time: 0.099475 Aug 24 11:32:23.926704 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 367/720] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:23 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:24.094316 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c6350dca-2e51-4857-8de5-4775657665de tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:24.094852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c6350dca-2e51-4857-8de5-4775657665de tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:24.101021 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6350dca-2e51-4857-8de5-4775657665de tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.101509 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6350dca-2e51-4857-8de5-4775657665de tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.101966 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6350dca-2e51-4857-8de5-4775657665de tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.102655 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6350dca-2e51-4857-8de5-4775657665de tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.103106 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6350dca-2e51-4857-8de5-4775657665de tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.103524 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c6350dca-2e51-4857-8de5-4775657665de tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.243205 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c6350dca-2e51-4857-8de5-4775657665de tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:24.251943 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c6350dca-2e51-4857-8de5-4775657665de tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.162178 Aug 24 11:32:24.252506 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 354/721] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:24 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:24.612614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-841532fa-2169-4dfc-9c77-e8ea3ab825d8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:24.613219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-841532fa-2169-4dfc-9c77-e8ea3ab825d8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:24.620358 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-841532fa-2169-4dfc-9c77-e8ea3ab825d8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.620836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-841532fa-2169-4dfc-9c77-e8ea3ab825d8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.621269 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-841532fa-2169-4dfc-9c77-e8ea3ab825d8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.622001 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-841532fa-2169-4dfc-9c77-e8ea3ab825d8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.622432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-841532fa-2169-4dfc-9c77-e8ea3ab825d8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.622848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-841532fa-2169-4dfc-9c77-e8ea3ab825d8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.765543 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-841532fa-2169-4dfc-9c77-e8ea3ab825d8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:24.774136 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-841532fa-2169-4dfc-9c77-e8ea3ab825d8 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1759 microversion: 2.1 time: 0.165412 Aug 24 11:32:24.774713 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 368/722] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:24 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:24.946642 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9c76221b-8388-43c2-bec8-b920a36efbdb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:24.947266 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9c76221b-8388-43c2-bec8-b920a36efbdb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:24.954347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9c76221b-8388-43c2-bec8-b920a36efbdb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.954759 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9c76221b-8388-43c2-bec8-b920a36efbdb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.955187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9c76221b-8388-43c2-bec8-b920a36efbdb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.955859 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9c76221b-8388-43c2-bec8-b920a36efbdb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:24.956304 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9c76221b-8388-43c2-bec8-b920a36efbdb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:24.956714 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9c76221b-8388-43c2-bec8-b920a36efbdb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:24.970032 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-9c76221b-8388-43c2-bec8-b920a36efbdb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] HTTP exception thrown: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9c76221b-8388-43c2-bec8-b920a36efbdb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Request method failure captured: Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 HTTP/1.1 Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgqETgNFLZN-cxtSDRr_AFoOlwFhwLX-ENYaVxJIHruplC9b_hdqfdtCiKQ8e38a_s-rndXFIgCY0GxucbSuzC9p3nENX8PLFIsqMQamCWy7Yc0bmYX9_A7TAaleaFSwaJqPHdkBljR5oJSERsZWj2B6SSpAFNzgXV0qWmNYC4EPrM8 Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:32:24.971664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:32:24.973175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6e41187605624091a4edc1993c4357e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6e41187605624091a4edc1993c4357e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:32:24.973175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:32:24.973175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:32:24.973175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:32:24.973175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:32:24.973175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:32:24.973175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:32:24.973175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 92712c36310c440c94da6c432c77a895 Aug 24 11:32:24.973175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:32:24.973175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:32:24.973175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:32:24.973175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': '855ac5ba-541c-4dc9-8a34-122679948e06'} Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:32:24.974062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:32:24.975475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:32:24.976786 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9c76221b-8388-43c2-bec8-b920a36efbdb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Returning 404 to user: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:32:24.976786 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9c76221b-8388-43c2-bec8-b920a36efbdb tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 404 len: 111 microversion: 2.1 time: 0.030242 Aug 24 11:32:24.976786 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 355/723] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:24 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:32:24.981912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-066059db-bf92-4af6-a5f7-eb2411c391a1 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '.version_select at 0x7f72420faee0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:25.068157 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-066059db-bf92-4af6-a5f7-eb2411c391a1 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1413081741" status: 202 len: 0 microversion: 2.1 time: 0.089974 Aug 24 11:32:25.068932 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 369/724] 10.222.0.83 () {58 vars in 1221 bytes} [Wed Aug 24 11:32:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1413081741 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:32:25.280006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-eb6a7d07-36f1-4c74-98d4-77dd2b93524f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:25.280006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-eb6a7d07-36f1-4c74-98d4-77dd2b93524f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:25.284972 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb6a7d07-36f1-4c74-98d4-77dd2b93524f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.284972 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb6a7d07-36f1-4c74-98d4-77dd2b93524f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.284972 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb6a7d07-36f1-4c74-98d4-77dd2b93524f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.284972 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb6a7d07-36f1-4c74-98d4-77dd2b93524f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:25.285391 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb6a7d07-36f1-4c74-98d4-77dd2b93524f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:25.285391 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb6a7d07-36f1-4c74-98d4-77dd2b93524f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:25.427717 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-eb6a7d07-36f1-4c74-98d4-77dd2b93524f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:25.435876 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-eb6a7d07-36f1-4c74-98d4-77dd2b93524f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.165878 Aug 24 11:32:25.437230 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 356/725] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:25 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:25.891219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a6393108-b5e0-4f6e-917d-eb02aeedd171 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Action: 'create', calling method: .version_select at 0x7f723d805940>, body: {"keypair": {"name": "tempest-keypair-106925069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvsNdSSg09V4UmbqpX/FWr2y3wEp1qmNsGJnxb9q5se/BfzLrVuCzkdCzAYLAC4eLEetZZYsF0uBjn012C9SzeyTU6Mol2REJkVP2fiIGw/Vz3T0lNYefI900SV9nmjhQ=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:25.908220 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-a6393108-b5e0-4f6e-917d-eb02aeedd171 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for project 6e41187605624091a4edc1993c4357e4. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:32:25.912254 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-a6393108-b5e0-4f6e-917d-eb02aeedd171 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for user 92712c36310c440c94da6c432c77a895 and project 6e41187605624091a4edc1993c4357e4. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:32:26.038101 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a6393108-b5e0-4f6e-917d-eb02aeedd171 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.150630 Aug 24 11:32:26.038727 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 370/726] 10.222.0.83 () {60 vars in 1159 bytes} [Wed Aug 24 11:32:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:26.459470 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c8c348fc-3c83-4f06-988b-8fa2717d92f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:26.460082 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c8c348fc-3c83-4f06-988b-8fa2717d92f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:26.466650 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c8c348fc-3c83-4f06-988b-8fa2717d92f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.467137 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c8c348fc-3c83-4f06-988b-8fa2717d92f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.468714 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c8c348fc-3c83-4f06-988b-8fa2717d92f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.468714 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c8c348fc-3c83-4f06-988b-8fa2717d92f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:26.472202 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c8c348fc-3c83-4f06-988b-8fa2717d92f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:26.472202 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c8c348fc-3c83-4f06-988b-8fa2717d92f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:26.614864 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c8c348fc-3c83-4f06-988b-8fa2717d92f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:26.622958 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c8c348fc-3c83-4f06-988b-8fa2717d92f9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.167332 Aug 24 11:32:26.623531 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 357/727] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:26 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:27.646328 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-56651e67-3d1d-40c9-90a4-6e9b5ff7f755 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:27.646945 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-56651e67-3d1d-40c9-90a4-6e9b5ff7f755 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:27.653198 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-56651e67-3d1d-40c9-90a4-6e9b5ff7f755 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.653689 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-56651e67-3d1d-40c9-90a4-6e9b5ff7f755 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.654279 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-56651e67-3d1d-40c9-90a4-6e9b5ff7f755 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.655000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-56651e67-3d1d-40c9-90a4-6e9b5ff7f755 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:27.656020 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-56651e67-3d1d-40c9-90a4-6e9b5ff7f755 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:27.656442 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-56651e67-3d1d-40c9-90a4-6e9b5ff7f755 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:27.820366 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-56651e67-3d1d-40c9-90a4-6e9b5ff7f755 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:27.828676 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-56651e67-3d1d-40c9-90a4-6e9b5ff7f755 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.187479 Aug 24 11:32:27.829233 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 371/728] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:27 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:28.400551 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-841642215", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e65e35e5-b291-45e0-99cd-ea04855e4be5"}], "security_groups": [{"name": "tempest-securitygroup--1103455483"}], "key_name": "tempest-keypair-106925069", "user_data": "}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:28.503993 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] validate_networks() for [('e65e35e5-b291-45e0-99cd-ea04855e4be5', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:32:28.849463 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c36cc863-a76d-4a77-964c-7b3dc60eea8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:28.850106 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c36cc863-a76d-4a77-964c-7b3dc60eea8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:28.856544 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c36cc863-a76d-4a77-964c-7b3dc60eea8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.857072 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c36cc863-a76d-4a77-964c-7b3dc60eea8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.857503 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c36cc863-a76d-4a77-964c-7b3dc60eea8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.860088 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c36cc863-a76d-4a77-964c-7b3dc60eea8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.860088 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c36cc863-a76d-4a77-964c-7b3dc60eea8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.860088 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c36cc863-a76d-4a77-964c-7b3dc60eea8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.923889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:32:28.924317 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:32:28.924824 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:32:28.925267 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:32:28.925677 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:32:28.934704 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.935167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.935753 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.937011 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:28.937458 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:28.937893 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:28.946662 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:28.960245 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for project 6e41187605624091a4edc1993c4357e4. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:32:28.962713 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:28.965177 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for user 92712c36310c440c94da6c432c77a895 and project 6e41187605624091a4edc1993c4357e4. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:32:28.977045 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:32:28.979473 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:32:28.997611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c36cc863-a76d-4a77-964c-7b3dc60eea8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:29.005351 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c36cc863-a76d-4a77-964c-7b3dc60eea8d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.159843 Aug 24 11:32:29.005937 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 372/729] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:28 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:29.109967 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a5f628cc-3f0a-49d0-ab56-64be89ff92d5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.713597 Aug 24 11:32:29.111248 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 358/730] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:32:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:32:29.122066 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a3bec850-b8e3-4f3f-bf67-329b23654844 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:29.122853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a3bec850-b8e3-4f3f-bf67-329b23654844 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:29.181105 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a3bec850-b8e3-4f3f-bf67-329b23654844 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:29.190254 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a3bec850-b8e3-4f3f-bf67-329b23654844 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1240 microversion: 2.1 time: 0.072328 Aug 24 11:32:29.192741 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 373/731] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:29 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:30.028531 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7309fe83-452a-45e7-b910-40373a0dbb40 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:30.029131 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7309fe83-452a-45e7-b910-40373a0dbb40 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:30.038465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7309fe83-452a-45e7-b910-40373a0dbb40 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.038958 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7309fe83-452a-45e7-b910-40373a0dbb40 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.040035 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7309fe83-452a-45e7-b910-40373a0dbb40 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.040167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7309fe83-452a-45e7-b910-40373a0dbb40 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.040527 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7309fe83-452a-45e7-b910-40373a0dbb40 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.040995 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7309fe83-452a-45e7-b910-40373a0dbb40 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.182500 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7309fe83-452a-45e7-b910-40373a0dbb40 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:30.190983 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7309fe83-452a-45e7-b910-40373a0dbb40 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.166990 Aug 24 11:32:30.191555 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 359/732] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:30 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:30.215512 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4bc73591-436c-4c93-bc55-bb3c40681b25 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:30.216117 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4bc73591-436c-4c93-bc55-bb3c40681b25 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:30.222298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bc73591-436c-4c93-bc55-bb3c40681b25 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.222777 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bc73591-436c-4c93-bc55-bb3c40681b25 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.223208 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bc73591-436c-4c93-bc55-bb3c40681b25 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.223884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bc73591-436c-4c93-bc55-bb3c40681b25 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:30.224366 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bc73591-436c-4c93-bc55-bb3c40681b25 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:30.224784 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bc73591-436c-4c93-bc55-bb3c40681b25 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:30.288018 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4bc73591-436c-4c93-bc55-bb3c40681b25 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:30.295801 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4bc73591-436c-4c93-bc55-bb3c40681b25 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1244 microversion: 2.1 time: 0.084382 Aug 24 11:32:30.296375 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 374/733] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:30 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:31.212863 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-31083992-2122-4f64-a1b9-047a021fb9b6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:31.213628 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-31083992-2122-4f64-a1b9-047a021fb9b6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:31.221624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-31083992-2122-4f64-a1b9-047a021fb9b6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.222150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-31083992-2122-4f64-a1b9-047a021fb9b6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.222588 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-31083992-2122-4f64-a1b9-047a021fb9b6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.223291 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-31083992-2122-4f64-a1b9-047a021fb9b6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.223748 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-31083992-2122-4f64-a1b9-047a021fb9b6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.224172 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-31083992-2122-4f64-a1b9-047a021fb9b6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.317863 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-19fab9c2-c0e9-4e4e-bf2c-928b28995d54 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:31.318530 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-19fab9c2-c0e9-4e4e-bf2c-928b28995d54 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:31.328151 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19fab9c2-c0e9-4e4e-bf2c-928b28995d54 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.328646 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19fab9c2-c0e9-4e4e-bf2c-928b28995d54 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.329100 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19fab9c2-c0e9-4e4e-bf2c-928b28995d54 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.329790 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19fab9c2-c0e9-4e4e-bf2c-928b28995d54 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:31.330275 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19fab9c2-c0e9-4e4e-bf2c-928b28995d54 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:31.330695 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19fab9c2-c0e9-4e4e-bf2c-928b28995d54 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:31.381254 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-31083992-2122-4f64-a1b9-047a021fb9b6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.390105 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-31083992-2122-4f64-a1b9-047a021fb9b6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.180698 Aug 24 11:32:31.390904 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 360/734] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:31 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:31.399682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-19fab9c2-c0e9-4e4e-bf2c-928b28995d54 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:31.411145 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-19fab9c2-c0e9-4e4e-bf2c-928b28995d54 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1292 microversion: 2.1 time: 0.098652 Aug 24 11:32:31.411752 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 375/735] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:31 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1292 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:32.413084 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-efce7ac6-00e1-4b77-8823-1d393a85a878 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:32.414136 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-efce7ac6-00e1-4b77-8823-1d393a85a878 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:32.423302 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-efce7ac6-00e1-4b77-8823-1d393a85a878 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.424036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-efce7ac6-00e1-4b77-8823-1d393a85a878 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.424599 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-efce7ac6-00e1-4b77-8823-1d393a85a878 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.427755 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-efce7ac6-00e1-4b77-8823-1d393a85a878 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.427755 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-efce7ac6-00e1-4b77-8823-1d393a85a878 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.427755 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-efce7ac6-00e1-4b77-8823-1d393a85a878 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.433718 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c5e9ae80-6c67-443b-907a-64088ea35016 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:32.436387 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c5e9ae80-6c67-443b-907a-64088ea35016 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:32.449237 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5e9ae80-6c67-443b-907a-64088ea35016 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.449987 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5e9ae80-6c67-443b-907a-64088ea35016 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.451375 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5e9ae80-6c67-443b-907a-64088ea35016 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.455138 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5e9ae80-6c67-443b-907a-64088ea35016 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:32.455636 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5e9ae80-6c67-443b-907a-64088ea35016 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:32.456080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5e9ae80-6c67-443b-907a-64088ea35016 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:32.603678 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c5e9ae80-6c67-443b-907a-64088ea35016 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.611309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c5e9ae80-6c67-443b-907a-64088ea35016 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1366 microversion: 2.1 time: 0.181926 Aug 24 11:32:32.611889 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 376/736] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:32 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:32.685318 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-efce7ac6-00e1-4b77-8823-1d393a85a878 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:32.693989 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-efce7ac6-00e1-4b77-8823-1d393a85a878 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.285151 Aug 24 11:32:32.694669 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 361/737] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:32 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:33.140246 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-7642f52a-bd53-42be-b6a8-5e6b274f312b req-f60f8f0c-858a-414a-89c4-01f5cc49ac20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2", "tag": "2d1ddad6-43a4-4d02-bfd5-d1a80c55b4a0"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:33.150286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-7642f52a-bd53-42be-b6a8-5e6b274f312b req-f60f8f0c-858a-414a-89c4-01f5cc49ac20 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.150765 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-7642f52a-bd53-42be-b6a8-5e6b274f312b req-f60f8f0c-858a-414a-89c4-01f5cc49ac20 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.151211 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-7642f52a-bd53-42be-b6a8-5e6b274f312b req-f60f8f0c-858a-414a-89c4-01f5cc49ac20 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.162754 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-7642f52a-bd53-42be-b6a8-5e6b274f312b req-f60f8f0c-858a-414a-89c4-01f5cc49ac20 service nova] Creating event network-changed:2d1ddad6-43a4-4d02-bfd5-d1a80c55b4a0 for instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 on hv-cinder-85427 Aug 24 11:32:33.167943 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-7642f52a-bd53-42be-b6a8-5e6b274f312b req-f60f8f0c-858a-414a-89c4-01f5cc49ac20 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031592 Aug 24 11:32:33.168731 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 377/738] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:33.639830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5cf6b562-6f1b-4a6e-a91f-e12ca403f22f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:33.640454 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5cf6b562-6f1b-4a6e-a91f-e12ca403f22f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:33.647991 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5cf6b562-6f1b-4a6e-a91f-e12ca403f22f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.648518 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5cf6b562-6f1b-4a6e-a91f-e12ca403f22f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.648951 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5cf6b562-6f1b-4a6e-a91f-e12ca403f22f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.650794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5cf6b562-6f1b-4a6e-a91f-e12ca403f22f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.650794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5cf6b562-6f1b-4a6e-a91f-e12ca403f22f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.650794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5cf6b562-6f1b-4a6e-a91f-e12ca403f22f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.718328 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5528d6d5-5048-4c29-841d-2f25d77b9483 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:33.721786 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5528d6d5-5048-4c29-841d-2f25d77b9483 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:33.727577 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5528d6d5-5048-4c29-841d-2f25d77b9483 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.728076 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5528d6d5-5048-4c29-841d-2f25d77b9483 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.728517 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5528d6d5-5048-4c29-841d-2f25d77b9483 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.729892 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5528d6d5-5048-4c29-841d-2f25d77b9483 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:33.730760 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5528d6d5-5048-4c29-841d-2f25d77b9483 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:33.731380 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5528d6d5-5048-4c29-841d-2f25d77b9483 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:33.842908 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5cf6b562-6f1b-4a6e-a91f-e12ca403f22f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.851674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5cf6b562-6f1b-4a6e-a91f-e12ca403f22f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1366 microversion: 2.1 time: 0.216160 Aug 24 11:32:33.852243 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 362/739] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:33 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:33.949791 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5528d6d5-5048-4c29-841d-2f25d77b9483 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:33.958646 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5528d6d5-5048-4c29-841d-2f25d77b9483 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.246010 Aug 24 11:32:33.959449 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 378/740] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:33 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:34.872464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-853a4a40-c4bc-4934-9153-9cf3260f66c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:34.873153 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-853a4a40-c4bc-4934-9153-9cf3260f66c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:34.880105 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-853a4a40-c4bc-4934-9153-9cf3260f66c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.880587 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-853a4a40-c4bc-4934-9153-9cf3260f66c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.881024 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-853a4a40-c4bc-4934-9153-9cf3260f66c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.881716 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-853a4a40-c4bc-4934-9153-9cf3260f66c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.882204 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-853a4a40-c4bc-4934-9153-9cf3260f66c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.882628 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-853a4a40-c4bc-4934-9153-9cf3260f66c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.979750 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-33c75064-4deb-45bb-a55a-b9f65816a587 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:34.980450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-33c75064-4deb-45bb-a55a-b9f65816a587 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:34.986840 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33c75064-4deb-45bb-a55a-b9f65816a587 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.987322 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33c75064-4deb-45bb-a55a-b9f65816a587 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.987755 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33c75064-4deb-45bb-a55a-b9f65816a587 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:34.988452 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33c75064-4deb-45bb-a55a-b9f65816a587 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:34.988909 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33c75064-4deb-45bb-a55a-b9f65816a587 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:34.989329 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-33c75064-4deb-45bb-a55a-b9f65816a587 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:35.015347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-853a4a40-c4bc-4934-9153-9cf3260f66c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:35.023499 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-853a4a40-c4bc-4934-9153-9cf3260f66c6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1366 microversion: 2.1 time: 0.154894 Aug 24 11:32:35.024071 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 363/741] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:34 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:35.122141 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-33c75064-4deb-45bb-a55a-b9f65816a587 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:35.130615 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-33c75064-4deb-45bb-a55a-b9f65816a587 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.154680 Aug 24 11:32:35.131119 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 379/742] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:34 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:36.044015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f628adf0-75b0-49b1-be07-9fd123537ba8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:36.044630 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f628adf0-75b0-49b1-be07-9fd123537ba8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:36.051375 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f628adf0-75b0-49b1-be07-9fd123537ba8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.051927 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f628adf0-75b0-49b1-be07-9fd123537ba8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.052352 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f628adf0-75b0-49b1-be07-9fd123537ba8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.053127 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f628adf0-75b0-49b1-be07-9fd123537ba8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.053500 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f628adf0-75b0-49b1-be07-9fd123537ba8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.053944 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f628adf0-75b0-49b1-be07-9fd123537ba8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.152234 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2c0f6653-4f8f-4d2a-9ddd-39a29106f99d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:36.152939 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2c0f6653-4f8f-4d2a-9ddd-39a29106f99d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:36.160211 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c0f6653-4f8f-4d2a-9ddd-39a29106f99d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.160781 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c0f6653-4f8f-4d2a-9ddd-39a29106f99d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.161319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c0f6653-4f8f-4d2a-9ddd-39a29106f99d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.162121 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c0f6653-4f8f-4d2a-9ddd-39a29106f99d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:36.162591 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c0f6653-4f8f-4d2a-9ddd-39a29106f99d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:36.163017 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c0f6653-4f8f-4d2a-9ddd-39a29106f99d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:36.188344 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f628adf0-75b0-49b1-be07-9fd123537ba8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.197342 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f628adf0-75b0-49b1-be07-9fd123537ba8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1366 microversion: 2.1 time: 0.156756 Aug 24 11:32:36.200357 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 364/743] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:36 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:36.300253 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2c0f6653-4f8f-4d2a-9ddd-39a29106f99d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:36.312833 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2c0f6653-4f8f-4d2a-9ddd-39a29106f99d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.159764 Aug 24 11:32:36.312833 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 380/744] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:36 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:37.218601 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8c86e3eb-fd5c-44c0-89f2-521180cdd589 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:37.219209 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8c86e3eb-fd5c-44c0-89f2-521180cdd589 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:37.225677 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8c86e3eb-fd5c-44c0-89f2-521180cdd589 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.226197 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8c86e3eb-fd5c-44c0-89f2-521180cdd589 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.226627 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8c86e3eb-fd5c-44c0-89f2-521180cdd589 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.227308 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8c86e3eb-fd5c-44c0-89f2-521180cdd589 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.227763 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8c86e3eb-fd5c-44c0-89f2-521180cdd589 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.228179 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8c86e3eb-fd5c-44c0-89f2-521180cdd589 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.330443 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6ac6211e-15e6-4563-a4a5-3cf4bc6f8f2d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:37.330443 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6ac6211e-15e6-4563-a4a5-3cf4bc6f8f2d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:37.336653 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ac6211e-15e6-4563-a4a5-3cf4bc6f8f2d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.337163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ac6211e-15e6-4563-a4a5-3cf4bc6f8f2d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.337598 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ac6211e-15e6-4563-a4a5-3cf4bc6f8f2d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.338361 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ac6211e-15e6-4563-a4a5-3cf4bc6f8f2d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:37.338815 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ac6211e-15e6-4563-a4a5-3cf4bc6f8f2d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:37.339235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ac6211e-15e6-4563-a4a5-3cf4bc6f8f2d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:37.359531 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8c86e3eb-fd5c-44c0-89f2-521180cdd589 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:37.370549 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8c86e3eb-fd5c-44c0-89f2-521180cdd589 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1366 microversion: 2.1 time: 0.156263 Aug 24 11:32:37.371144 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 365/745] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:37 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:37.473224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6ac6211e-15e6-4563-a4a5-3cf4bc6f8f2d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:37.481063 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6ac6211e-15e6-4563-a4a5-3cf4bc6f8f2d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.155534 Aug 24 11:32:37.481636 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 381/746] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:37 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:38.391979 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f12f9caf-520f-466e-bf33-00647e4d0b6b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:38.392595 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f12f9caf-520f-466e-bf33-00647e4d0b6b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:38.399047 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f12f9caf-520f-466e-bf33-00647e4d0b6b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.399533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f12f9caf-520f-466e-bf33-00647e4d0b6b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.400016 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f12f9caf-520f-466e-bf33-00647e4d0b6b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.400709 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f12f9caf-520f-466e-bf33-00647e4d0b6b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.401159 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f12f9caf-520f-466e-bf33-00647e4d0b6b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.401577 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f12f9caf-520f-466e-bf33-00647e4d0b6b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.503916 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-787198c5-c00c-4cd4-b16b-283ac9e13d93 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:38.504531 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-787198c5-c00c-4cd4-b16b-283ac9e13d93 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:38.511087 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-787198c5-c00c-4cd4-b16b-283ac9e13d93 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.511571 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-787198c5-c00c-4cd4-b16b-283ac9e13d93 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.512010 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-787198c5-c00c-4cd4-b16b-283ac9e13d93 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.512711 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-787198c5-c00c-4cd4-b16b-283ac9e13d93 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:38.513201 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-787198c5-c00c-4cd4-b16b-283ac9e13d93 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:38.513624 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-787198c5-c00c-4cd4-b16b-283ac9e13d93 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:38.539127 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f12f9caf-520f-466e-bf33-00647e4d0b6b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:38.547745 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f12f9caf-520f-466e-bf33-00647e4d0b6b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1366 microversion: 2.1 time: 0.159715 Aug 24 11:32:38.548322 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 366/747] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:38 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:38.652168 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-787198c5-c00c-4cd4-b16b-283ac9e13d93 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:38.660548 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-787198c5-c00c-4cd4-b16b-283ac9e13d93 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.161736 Aug 24 11:32:38.661119 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 382/748] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:38 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:32:39.577656 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7d0e40a1-2994-4120-9c18-4360d5c18110 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:39.590133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7d0e40a1-2994-4120-9c18-4360d5c18110 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:39.590133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:39.590133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=6 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:39.590133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7d0e40a1-2994-4120-9c18-4360d5c18110 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.590133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7d0e40a1-2994-4120-9c18-4360d5c18110 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.590643 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7d0e40a1-2994-4120-9c18-4360d5c18110 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.590643 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7d0e40a1-2994-4120-9c18-4360d5c18110 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.590643 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7d0e40a1-2994-4120-9c18-4360d5c18110 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.590643 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7d0e40a1-2994-4120-9c18-4360d5c18110 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.683227 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1bdcff32-ef34-465b-b56a-84ef8129a8f2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:39.684569 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1bdcff32-ef34-465b-b56a-84ef8129a8f2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:39.690667 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:39.693632 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1bdcff32-ef34-465b-b56a-84ef8129a8f2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.694431 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1bdcff32-ef34-465b-b56a-84ef8129a8f2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.694966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1bdcff32-ef34-465b-b56a-84ef8129a8f2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.695948 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1bdcff32-ef34-465b-b56a-84ef8129a8f2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.696526 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1bdcff32-ef34-465b-b56a-84ef8129a8f2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.697046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1bdcff32-ef34-465b-b56a-84ef8129a8f2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.729518 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7d0e40a1-2994-4120-9c18-4360d5c18110 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:39.739062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7d0e40a1-2994-4120-9c18-4360d5c18110 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1366 microversion: 2.1 time: 0.166151 Aug 24 11:32:39.739965 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 367/749] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:39 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:39.843993 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-142dc131-75fa-465d-b701-f3c31081a3ee req-2ff2ede1-3999-475c-a0bb-724700671b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b6e400-1d49-417d-9140-692da71f9da6", "name": "network-vif-unplugged", "status": "completed", "tag": "c09687c1-5de4-4274-b42a-5caf8a2d5adb"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:39.845845 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1bdcff32-ef34-465b-b56a-84ef8129a8f2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:39.853690 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-142dc131-75fa-465d-b701-f3c31081a3ee req-2ff2ede1-3999-475c-a0bb-724700671b4d service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.856466 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1bdcff32-ef34-465b-b56a-84ef8129a8f2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1568 microversion: 2.1 time: 0.175251 Aug 24 11:32:39.856601 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-142dc131-75fa-465d-b701-f3c31081a3ee req-2ff2ede1-3999-475c-a0bb-724700671b4d service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.856601 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-142dc131-75fa-465d-b701-f3c31081a3ee req-2ff2ede1-3999-475c-a0bb-724700671b4d service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.856836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 383/750] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:39 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:39.866973 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-142dc131-75fa-465d-b701-f3c31081a3ee req-2ff2ede1-3999-475c-a0bb-724700671b4d service nova] Creating event network-vif-unplugged:c09687c1-5de4-4274-b42a-5caf8a2d5adb for instance a9b6e400-1d49-417d-9140-692da71f9da6 on hv-cinder-85427 Aug 24 11:32:39.872282 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-142dc131-75fa-465d-b701-f3c31081a3ee req-2ff2ede1-3999-475c-a0bb-724700671b4d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109546 Aug 24 11:32:39.872879 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 368/751] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:32:39.876072 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6482512d-2a7c-42d8-88a5-8f66fb911d7b tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:39.876659 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6482512d-2a7c-42d8-88a5-8f66fb911d7b tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:39.883081 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6482512d-2a7c-42d8-88a5-8f66fb911d7b tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.885166 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6482512d-2a7c-42d8-88a5-8f66fb911d7b tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.885166 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6482512d-2a7c-42d8-88a5-8f66fb911d7b tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.885166 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6482512d-2a7c-42d8-88a5-8f66fb911d7b tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:39.885166 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6482512d-2a7c-42d8-88a5-8f66fb911d7b tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:39.885705 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6482512d-2a7c-42d8-88a5-8f66fb911d7b tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:39.984306 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6482512d-2a7c-42d8-88a5-8f66fb911d7b tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121221) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 11:32:40.315345 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6482512d-2a7c-42d8-88a5-8f66fb911d7b tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "POST /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6/action" status: 202 len: 0 microversion: 2.1 time: 0.444183 Aug 24 11:32:40.322137 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 384/752] 10.222.0.83 () {60 vars in 1278 bytes} [Wed Aug 24 11:32:39 2022] POST /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:32:40.325226 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-59eefddd-9010-4769-bdc6-6136fb5f46c1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:40.326168 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-59eefddd-9010-4769-bdc6-6136fb5f46c1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:40.332573 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-59eefddd-9010-4769-bdc6-6136fb5f46c1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:40.333056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-59eefddd-9010-4769-bdc6-6136fb5f46c1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:40.333489 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-59eefddd-9010-4769-bdc6-6136fb5f46c1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:40.334268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-59eefddd-9010-4769-bdc6-6136fb5f46c1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:40.334889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-59eefddd-9010-4769-bdc6-6136fb5f46c1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:40.335326 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-59eefddd-9010-4769-bdc6-6136fb5f46c1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:40.472163 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-59eefddd-9010-4769-bdc6-6136fb5f46c1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:40.480074 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-59eefddd-9010-4769-bdc6-6136fb5f46c1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1516 microversion: 2.1 time: 0.159478 Aug 24 11:32:40.480837 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 369/753] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:40 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:40.762517 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a4cf5b06-ed00-4bb9-9a9e-13c80b9261f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:40.763134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a4cf5b06-ed00-4bb9-9a9e-13c80b9261f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:40.770211 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4cf5b06-ed00-4bb9-9a9e-13c80b9261f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:40.770701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4cf5b06-ed00-4bb9-9a9e-13c80b9261f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:40.771137 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4cf5b06-ed00-4bb9-9a9e-13c80b9261f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:40.771824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4cf5b06-ed00-4bb9-9a9e-13c80b9261f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:40.772295 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4cf5b06-ed00-4bb9-9a9e-13c80b9261f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:40.772821 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4cf5b06-ed00-4bb9-9a9e-13c80b9261f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:40.907182 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a4cf5b06-ed00-4bb9-9a9e-13c80b9261f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:40.910761 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:40.915328 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a4cf5b06-ed00-4bb9-9a9e-13c80b9261f8 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1366 microversion: 2.1 time: 0.157159 Aug 24 11:32:40.915925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 385/754] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:40 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:41.500622 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c9fce12c-1126-416b-876a-6889e81d2a31 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:41.501163 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c9fce12c-1126-416b-876a-6889e81d2a31 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:41.507879 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c9fce12c-1126-416b-876a-6889e81d2a31 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.508417 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c9fce12c-1126-416b-876a-6889e81d2a31 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.513639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c9fce12c-1126-416b-876a-6889e81d2a31 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.513639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c9fce12c-1126-416b-876a-6889e81d2a31 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.513639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c9fce12c-1126-416b-876a-6889e81d2a31 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.513639 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c9fce12c-1126-416b-876a-6889e81d2a31 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.648873 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c9fce12c-1126-416b-876a-6889e81d2a31 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:41.656707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c9fce12c-1126-416b-876a-6889e81d2a31 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1516 microversion: 2.1 time: 0.159884 Aug 24 11:32:41.659276 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 370/755] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:41 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:41.936797 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-04835275-27b1-4dce-9f4f-da7d2c1ed03d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:41.937441 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-04835275-27b1-4dce-9f4f-da7d2c1ed03d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:41.944262 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-04835275-27b1-4dce-9f4f-da7d2c1ed03d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.948091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-04835275-27b1-4dce-9f4f-da7d2c1ed03d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.948091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-04835275-27b1-4dce-9f4f-da7d2c1ed03d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:41.948091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-04835275-27b1-4dce-9f4f-da7d2c1ed03d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:41.948091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-04835275-27b1-4dce-9f4f-da7d2c1ed03d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:41.948424 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-04835275-27b1-4dce-9f4f-da7d2c1ed03d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.087761 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-2f5b80b6-2c30-4f77-b148-d580928835fa req-9b37ecc8-29ac-46f8-a20a-1f96f124c408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2", "name": "network-vif-plugged", "status": "completed", "tag": "2d1ddad6-43a4-4d02-bfd5-d1a80c55b4a0"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:42.098324 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-2f5b80b6-2c30-4f77-b148-d580928835fa req-9b37ecc8-29ac-46f8-a20a-1f96f124c408 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.098800 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-2f5b80b6-2c30-4f77-b148-d580928835fa req-9b37ecc8-29ac-46f8-a20a-1f96f124c408 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.099236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-2f5b80b6-2c30-4f77-b148-d580928835fa req-9b37ecc8-29ac-46f8-a20a-1f96f124c408 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.111749 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-2f5b80b6-2c30-4f77-b148-d580928835fa req-9b37ecc8-29ac-46f8-a20a-1f96f124c408 service nova] Creating event network-vif-plugged:2d1ddad6-43a4-4d02-bfd5-d1a80c55b4a0 for instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 on hv-cinder-85427 Aug 24 11:32:42.116854 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-2f5b80b6-2c30-4f77-b148-d580928835fa req-9b37ecc8-29ac-46f8-a20a-1f96f124c408 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033095 Aug 24 11:32:42.119121 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 371/756] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:42.294348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-04835275-27b1-4dce-9f4f-da7d2c1ed03d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:42.302191 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-04835275-27b1-4dce-9f4f-da7d2c1ed03d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1366 microversion: 2.1 time: 0.370156 Aug 24 11:32:42.302772 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 386/757] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:41 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:42.677778 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8e534c06-b90e-4708-a60c-046e134860e2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:42.678544 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8e534c06-b90e-4708-a60c-046e134860e2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:42.685333 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e534c06-b90e-4708-a60c-046e134860e2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.685808 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e534c06-b90e-4708-a60c-046e134860e2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.686283 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e534c06-b90e-4708-a60c-046e134860e2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.686986 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e534c06-b90e-4708-a60c-046e134860e2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:42.687440 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e534c06-b90e-4708-a60c-046e134860e2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:42.687861 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e534c06-b90e-4708-a60c-046e134860e2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:42.833983 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8e534c06-b90e-4708-a60c-046e134860e2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:42.842391 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8e534c06-b90e-4708-a60c-046e134860e2 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1518 microversion: 2.1 time: 0.168463 Aug 24 11:32:42.843256 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 372/758] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:42 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:43.322965 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5ffc7346-166b-4eda-a25c-affa0e4216f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:43.323571 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5ffc7346-166b-4eda-a25c-affa0e4216f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:43.340384 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ffc7346-166b-4eda-a25c-affa0e4216f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.340384 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ffc7346-166b-4eda-a25c-affa0e4216f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.340384 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ffc7346-166b-4eda-a25c-affa0e4216f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.340384 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ffc7346-166b-4eda-a25c-affa0e4216f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.340793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ffc7346-166b-4eda-a25c-affa0e4216f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.340793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ffc7346-166b-4eda-a25c-affa0e4216f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.480169 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5ffc7346-166b-4eda-a25c-affa0e4216f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:43.487772 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5ffc7346-166b-4eda-a25c-affa0e4216f7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1366 microversion: 2.1 time: 0.168683 Aug 24 11:32:43.488341 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 387/759] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:43 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:43.864823 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0f34eb39-abc2-4627-9c7f-79f188e595af tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:43.865425 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0f34eb39-abc2-4627-9c7f-79f188e595af tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:43.875442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f34eb39-abc2-4627-9c7f-79f188e595af tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.875442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f34eb39-abc2-4627-9c7f-79f188e595af tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.875442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f34eb39-abc2-4627-9c7f-79f188e595af tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:43.875442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f34eb39-abc2-4627-9c7f-79f188e595af tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:43.875810 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f34eb39-abc2-4627-9c7f-79f188e595af tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:43.875810 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f34eb39-abc2-4627-9c7f-79f188e595af tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.009493 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0f34eb39-abc2-4627-9c7f-79f188e595af tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:44.017998 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0f34eb39-abc2-4627-9c7f-79f188e595af tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1518 microversion: 2.1 time: 0.157057 Aug 24 11:32:44.018564 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 373/760] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:43 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:44.508643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0d9103d3-b925-4f5b-aa7d-387b3091fa6e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:44.509441 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0d9103d3-b925-4f5b-aa7d-387b3091fa6e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:44.516270 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d9103d3-b925-4f5b-aa7d-387b3091fa6e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.516757 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d9103d3-b925-4f5b-aa7d-387b3091fa6e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.517192 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d9103d3-b925-4f5b-aa7d-387b3091fa6e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.517905 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d9103d3-b925-4f5b-aa7d-387b3091fa6e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:44.518358 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d9103d3-b925-4f5b-aa7d-387b3091fa6e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:44.518781 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d9103d3-b925-4f5b-aa7d-387b3091fa6e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:44.652534 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0d9103d3-b925-4f5b-aa7d-387b3091fa6e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:44.660789 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0d9103d3-b925-4f5b-aa7d-387b3091fa6e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1366 microversion: 2.1 time: 0.156032 Aug 24 11:32:44.662735 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 388/761] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:44 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:45.039548 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ece3e2c6-86be-4398-a986-66540a7b2fa8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:45.040164 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ece3e2c6-86be-4398-a986-66540a7b2fa8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:45.047118 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ece3e2c6-86be-4398-a986-66540a7b2fa8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.047599 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ece3e2c6-86be-4398-a986-66540a7b2fa8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.048039 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ece3e2c6-86be-4398-a986-66540a7b2fa8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.048726 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ece3e2c6-86be-4398-a986-66540a7b2fa8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.049183 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ece3e2c6-86be-4398-a986-66540a7b2fa8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.049605 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ece3e2c6-86be-4398-a986-66540a7b2fa8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.183338 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ece3e2c6-86be-4398-a986-66540a7b2fa8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:45.191881 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ece3e2c6-86be-4398-a986-66540a7b2fa8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1574 microversion: 2.1 time: 0.156229 Aug 24 11:32:45.192454 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 374/762] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:45 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:45.681560 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8b6d7a20-22d4-4dab-9bf1-4e7ce1e3d062 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:45.682187 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8b6d7a20-22d4-4dab-9bf1-4e7ce1e3d062 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:45.688601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b6d7a20-22d4-4dab-9bf1-4e7ce1e3d062 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.689078 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b6d7a20-22d4-4dab-9bf1-4e7ce1e3d062 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.689504 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b6d7a20-22d4-4dab-9bf1-4e7ce1e3d062 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.690218 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b6d7a20-22d4-4dab-9bf1-4e7ce1e3d062 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.690663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b6d7a20-22d4-4dab-9bf1-4e7ce1e3d062 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.691080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b6d7a20-22d4-4dab-9bf1-4e7ce1e3d062 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.818997 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8b6d7a20-22d4-4dab-9bf1-4e7ce1e3d062 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:45.827225 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8b6d7a20-22d4-4dab-9bf1-4e7ce1e3d062 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1555 microversion: 2.1 time: 0.149554 Aug 24 11:32:45.827796 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 389/763] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:45 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:45.847268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-520e3a09-4574-4b4b-aedb-c789e5fd4bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:45.847754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-520e3a09-4574-4b4b-aedb-c789e5fd4bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:45.853579 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-520e3a09-4574-4b4b-aedb-c789e5fd4bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.854099 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-520e3a09-4574-4b4b-aedb-c789e5fd4bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.854525 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-520e3a09-4574-4b4b-aedb-c789e5fd4bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.855211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-520e3a09-4574-4b4b-aedb-c789e5fd4bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:45.855656 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-520e3a09-4574-4b4b-aedb-c789e5fd4bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:45.856074 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-520e3a09-4574-4b4b-aedb-c789e5fd4bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:45.968473 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-520e3a09-4574-4b4b-aedb-c789e5fd4bff tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124994 Aug 24 11:32:45.969978 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 375/764] 10.222.0.83 () {58 vars in 1275 bytes} [Wed Aug 24 11:32:45 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:46.214152 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2a0d2fd8-f31c-4e5a-8f82-60fe414363d6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:46.215096 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2a0d2fd8-f31c-4e5a-8f82-60fe414363d6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:46.221911 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a0d2fd8-f31c-4e5a-8f82-60fe414363d6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:46.222684 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a0d2fd8-f31c-4e5a-8f82-60fe414363d6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:46.223339 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a0d2fd8-f31c-4e5a-8f82-60fe414363d6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.224250 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a0d2fd8-f31c-4e5a-8f82-60fe414363d6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:46.224943 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a0d2fd8-f31c-4e5a-8f82-60fe414363d6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:46.225466 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a0d2fd8-f31c-4e5a-8f82-60fe414363d6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:46.521072 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2a0d2fd8-f31c-4e5a-8f82-60fe414363d6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:46.529024 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2a0d2fd8-f31c-4e5a-8f82-60fe414363d6 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1574 microversion: 2.1 time: 0.318880 Aug 24 11:32:46.530225 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 390/765] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:46 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1574 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:47.089957 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-64b7f788-6be2-4ccb-a7bf-3a9906ee9f2b req-0e17e22b-3e39-47dd-8d4a-8399a4150598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2", "tag": "2d1ddad6-43a4-4d02-bfd5-d1a80c55b4a0"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:47.099834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-64b7f788-6be2-4ccb-a7bf-3a9906ee9f2b req-0e17e22b-3e39-47dd-8d4a-8399a4150598 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.100315 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-64b7f788-6be2-4ccb-a7bf-3a9906ee9f2b req-0e17e22b-3e39-47dd-8d4a-8399a4150598 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.100744 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-64b7f788-6be2-4ccb-a7bf-3a9906ee9f2b req-0e17e22b-3e39-47dd-8d4a-8399a4150598 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.112966 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-64b7f788-6be2-4ccb-a7bf-3a9906ee9f2b req-0e17e22b-3e39-47dd-8d4a-8399a4150598 service nova] Creating event network-changed:2d1ddad6-43a4-4d02-bfd5-d1a80c55b4a0 for instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 on hv-cinder-85427 Aug 24 11:32:47.118383 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-64b7f788-6be2-4ccb-a7bf-3a9906ee9f2b req-0e17e22b-3e39-47dd-8d4a-8399a4150598 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032490 Aug 24 11:32:47.119006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 376/766] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:47.660558 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-61412207-035d-4719-a270-9938eb9a56f8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:47.662014 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-61412207-035d-4719-a270-9938eb9a56f8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:47.668343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-61412207-035d-4719-a270-9938eb9a56f8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.668977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-61412207-035d-4719-a270-9938eb9a56f8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.669535 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-61412207-035d-4719-a270-9938eb9a56f8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.670898 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-61412207-035d-4719-a270-9938eb9a56f8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:47.671640 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-61412207-035d-4719-a270-9938eb9a56f8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:47.672223 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-61412207-035d-4719-a270-9938eb9a56f8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:47.815828 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-61412207-035d-4719-a270-9938eb9a56f8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:47.824604 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-61412207-035d-4719-a270-9938eb9a56f8 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1574 microversion: 2.1 time: 0.276807 Aug 24 11:32:47.825421 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 391/767] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:47 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1574 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:48.847716 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-790c3ed4-62ca-4e8d-87cd-c448bf50ed4a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:48.848413 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-790c3ed4-62ca-4e8d-87cd-c448bf50ed4a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:48.855443 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-790c3ed4-62ca-4e8d-87cd-c448bf50ed4a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.855923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-790c3ed4-62ca-4e8d-87cd-c448bf50ed4a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.856358 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-790c3ed4-62ca-4e8d-87cd-c448bf50ed4a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:48.857048 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-790c3ed4-62ca-4e8d-87cd-c448bf50ed4a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:48.857497 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-790c3ed4-62ca-4e8d-87cd-c448bf50ed4a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:48.857943 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-790c3ed4-62ca-4e8d-87cd-c448bf50ed4a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:48.993289 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-790c3ed4-62ca-4e8d-87cd-c448bf50ed4a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:48.997478 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=100 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:49.002352 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-790c3ed4-62ca-4e8d-87cd-c448bf50ed4a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1574 microversion: 2.1 time: 0.158887 Aug 24 11:32:49.011400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 377/768] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:48 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:50.023808 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6ec0f42d-decd-4e5c-b321-3c624b9bab3a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:50.024411 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6ec0f42d-decd-4e5c-b321-3c624b9bab3a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:50.031612 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ec0f42d-decd-4e5c-b321-3c624b9bab3a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.032088 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ec0f42d-decd-4e5c-b321-3c624b9bab3a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.032518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ec0f42d-decd-4e5c-b321-3c624b9bab3a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.033203 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ec0f42d-decd-4e5c-b321-3c624b9bab3a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:50.033651 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ec0f42d-decd-4e5c-b321-3c624b9bab3a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:50.034102 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ec0f42d-decd-4e5c-b321-3c624b9bab3a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:50.163313 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6ec0f42d-decd-4e5c-b321-3c624b9bab3a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:50.171719 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6ec0f42d-decd-4e5c-b321-3c624b9bab3a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1574 microversion: 2.1 time: 0.151829 Aug 24 11:32:50.172288 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 392/769] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:50 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:51.192968 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a7bd8a37-30be-490d-8468-8349c59d301d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:51.193572 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a7bd8a37-30be-490d-8468-8349c59d301d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:51.200548 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7bd8a37-30be-490d-8468-8349c59d301d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.201157 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7bd8a37-30be-490d-8468-8349c59d301d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.201850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7bd8a37-30be-490d-8468-8349c59d301d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.202577 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7bd8a37-30be-490d-8468-8349c59d301d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:51.203032 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7bd8a37-30be-490d-8468-8349c59d301d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:51.203454 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7bd8a37-30be-490d-8468-8349c59d301d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:51.418125 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a7bd8a37-30be-490d-8468-8349c59d301d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:51.426853 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a7bd8a37-30be-490d-8468-8349c59d301d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1574 microversion: 2.1 time: 0.238030 Aug 24 11:32:51.427482 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 378/770] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:51 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1574 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:52.448442 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5f7b756c-9365-4d77-9a48-ebc88ddaca6f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:52.449050 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5f7b756c-9365-4d77-9a48-ebc88ddaca6f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:52.456242 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f7b756c-9365-4d77-9a48-ebc88ddaca6f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.456722 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f7b756c-9365-4d77-9a48-ebc88ddaca6f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.457154 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f7b756c-9365-4d77-9a48-ebc88ddaca6f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:52.457911 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f7b756c-9365-4d77-9a48-ebc88ddaca6f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:52.458358 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f7b756c-9365-4d77-9a48-ebc88ddaca6f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:52.458806 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f7b756c-9365-4d77-9a48-ebc88ddaca6f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:52.592788 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5f7b756c-9365-4d77-9a48-ebc88ddaca6f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:52.600718 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5f7b756c-9365-4d77-9a48-ebc88ddaca6f tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1574 microversion: 2.1 time: 0.156294 Aug 24 11:32:52.601298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 393/771] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:52 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:53.622410 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-42c8bdf4-5b1d-405c-b1d8-285bb55b69bf tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:53.623504 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-42c8bdf4-5b1d-405c-b1d8-285bb55b69bf tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:53.630012 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-42c8bdf4-5b1d-405c-b1d8-285bb55b69bf tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:53.630489 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-42c8bdf4-5b1d-405c-b1d8-285bb55b69bf tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:53.630915 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-42c8bdf4-5b1d-405c-b1d8-285bb55b69bf tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:53.631590 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-42c8bdf4-5b1d-405c-b1d8-285bb55b69bf tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:53.632033 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-42c8bdf4-5b1d-405c-b1d8-285bb55b69bf tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:53.632445 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-42c8bdf4-5b1d-405c-b1d8-285bb55b69bf tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:53.767055 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-42c8bdf4-5b1d-405c-b1d8-285bb55b69bf tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:53.775020 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-42c8bdf4-5b1d-405c-b1d8-285bb55b69bf tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1574 microversion: 2.1 time: 0.156554 Aug 24 11:32:53.775593 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 379/772] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:53 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:54.795877 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2d3ef009-38c3-489a-883d-fc476195c725 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:54.796492 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2d3ef009-38c3-489a-883d-fc476195c725 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:54.798912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:32:54.803825 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d3ef009-38c3-489a-883d-fc476195c725 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:54.804346 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d3ef009-38c3-489a-883d-fc476195c725 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:54.806429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d3ef009-38c3-489a-883d-fc476195c725 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:54.806429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d3ef009-38c3-489a-883d-fc476195c725 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:54.806429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d3ef009-38c3-489a-883d-fc476195c725 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:54.806429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d3ef009-38c3-489a-883d-fc476195c725 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:54.941906 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2d3ef009-38c3-489a-883d-fc476195c725 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:54.950304 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2d3ef009-38c3-489a-883d-fc476195c725 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1574 microversion: 2.1 time: 0.158199 Aug 24 11:32:54.951443 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 394/773] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:54 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:55.975910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3a20fc65-bca9-4ba8-88cf-04c0ea844a62 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:55.980377 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3a20fc65-bca9-4ba8-88cf-04c0ea844a62 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:55.986344 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3a20fc65-bca9-4ba8-88cf-04c0ea844a62 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:55.986829 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3a20fc65-bca9-4ba8-88cf-04c0ea844a62 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:55.987258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3a20fc65-bca9-4ba8-88cf-04c0ea844a62 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:55.988050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3a20fc65-bca9-4ba8-88cf-04c0ea844a62 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:55.988597 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3a20fc65-bca9-4ba8-88cf-04c0ea844a62 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:55.989020 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3a20fc65-bca9-4ba8-88cf-04c0ea844a62 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:56.130356 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3a20fc65-bca9-4ba8-88cf-04c0ea844a62 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:56.139499 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3a20fc65-bca9-4ba8-88cf-04c0ea844a62 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1574 microversion: 2.1 time: 0.170000 Aug 24 11:32:56.140095 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 380/774] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:55 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:57.160953 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5e2d9e89-b1fe-43ee-b90a-a5469b9dc813 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:57.161572 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5e2d9e89-b1fe-43ee-b90a-a5469b9dc813 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:57.168432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e2d9e89-b1fe-43ee-b90a-a5469b9dc813 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:57.168916 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e2d9e89-b1fe-43ee-b90a-a5469b9dc813 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:57.169386 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e2d9e89-b1fe-43ee-b90a-a5469b9dc813 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:57.170103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e2d9e89-b1fe-43ee-b90a-a5469b9dc813 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:57.170562 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e2d9e89-b1fe-43ee-b90a-a5469b9dc813 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:57.170980 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e2d9e89-b1fe-43ee-b90a-a5469b9dc813 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:57.302642 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5e2d9e89-b1fe-43ee-b90a-a5469b9dc813 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:57.310537 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5e2d9e89-b1fe-43ee-b90a-a5469b9dc813 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1574 microversion: 2.1 time: 0.153434 Aug 24 11:32:57.311116 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 395/775] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:57 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:58.273566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-38b06fdb-fa3d-4958-bcc7-6f9b46e7c98f req-28ce19f6-9d34-444f-8e83-39d2f31f98af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b6e400-1d49-417d-9140-692da71f9da6", "name": "network-vif-plugged", "status": "completed", "tag": "c09687c1-5de4-4274-b42a-5caf8a2d5adb"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:32:58.283386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-38b06fdb-fa3d-4958-bcc7-6f9b46e7c98f req-28ce19f6-9d34-444f-8e83-39d2f31f98af service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:58.283858 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-38b06fdb-fa3d-4958-bcc7-6f9b46e7c98f req-28ce19f6-9d34-444f-8e83-39d2f31f98af service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:58.284278 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-38b06fdb-fa3d-4958-bcc7-6f9b46e7c98f req-28ce19f6-9d34-444f-8e83-39d2f31f98af service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:58.297725 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-38b06fdb-fa3d-4958-bcc7-6f9b46e7c98f req-28ce19f6-9d34-444f-8e83-39d2f31f98af service nova] Creating event network-vif-plugged:c09687c1-5de4-4274-b42a-5caf8a2d5adb for instance a9b6e400-1d49-417d-9140-692da71f9da6 on hv-cinder-85427 Aug 24 11:32:58.302802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-38b06fdb-fa3d-4958-bcc7-6f9b46e7c98f req-28ce19f6-9d34-444f-8e83-39d2f31f98af service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033993 Aug 24 11:32:58.303579 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 381/776] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:32:58.331212 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8ffd2916-b6c7-4013-83bd-9326da5421ee tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:58.331824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8ffd2916-b6c7-4013-83bd-9326da5421ee tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:58.338333 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ffd2916-b6c7-4013-83bd-9326da5421ee tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:58.338816 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ffd2916-b6c7-4013-83bd-9326da5421ee tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:58.339245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ffd2916-b6c7-4013-83bd-9326da5421ee tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:58.340323 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ffd2916-b6c7-4013-83bd-9326da5421ee tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:58.340449 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ffd2916-b6c7-4013-83bd-9326da5421ee tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:58.340879 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ffd2916-b6c7-4013-83bd-9326da5421ee tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:58.480368 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8ffd2916-b6c7-4013-83bd-9326da5421ee tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:58.488290 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8ffd2916-b6c7-4013-83bd-9326da5421ee tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1574 microversion: 2.1 time: 0.161002 Aug 24 11:32:58.488861 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 396/777] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:58 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:59.030067 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-dbdcccb1-6910-4025-8a40-6f6a881c49e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:59.032253 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-dbdcccb1-6910-4025-8a40-6f6a881c49e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:59.038456 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dbdcccb1-6910-4025-8a40-6f6a881c49e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:59.038940 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dbdcccb1-6910-4025-8a40-6f6a881c49e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:59.039375 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dbdcccb1-6910-4025-8a40-6f6a881c49e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:59.040056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dbdcccb1-6910-4025-8a40-6f6a881c49e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:59.040509 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dbdcccb1-6910-4025-8a40-6f6a881c49e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:59.040929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dbdcccb1-6910-4025-8a40-6f6a881c49e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:59.069526 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-dbdcccb1-6910-4025-8a40-6f6a881c49e1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044304 Aug 24 11:32:59.070097 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 382/778] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:32:59 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:32:59.132202 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4283f798-f994-47f7-8bc0-b22375050ab5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:59.132702 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4283f798-f994-47f7-8bc0-b22375050ab5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:59.139197 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4283f798-f994-47f7-8bc0-b22375050ab5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:59.139679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4283f798-f994-47f7-8bc0-b22375050ab5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:59.140119 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4283f798-f994-47f7-8bc0-b22375050ab5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:59.140809 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4283f798-f994-47f7-8bc0-b22375050ab5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:59.141266 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4283f798-f994-47f7-8bc0-b22375050ab5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:59.141691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4283f798-f994-47f7-8bc0-b22375050ab5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:59.166918 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4283f798-f994-47f7-8bc0-b22375050ab5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:32:59.442595 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4283f798-f994-47f7-8bc0-b22375050ab5 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 204 len: 0 microversion: 2.1 time: 0.313838 Aug 24 11:32:59.443251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 397/779] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:32:59 2022] DELETE /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:32:59.452388 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-76505456-58ba-4a49-b690-251565b4f61d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:59.453044 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-76505456-58ba-4a49-b690-251565b4f61d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:59.459645 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-76505456-58ba-4a49-b690-251565b4f61d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:59.460232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-76505456-58ba-4a49-b690-251565b4f61d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:59.460657 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-76505456-58ba-4a49-b690-251565b4f61d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:59.461344 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-76505456-58ba-4a49-b690-251565b4f61d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:59.461791 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-76505456-58ba-4a49-b690-251565b4f61d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:59.462238 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-76505456-58ba-4a49-b690-251565b4f61d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:59.510186 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-917f929d-a48c-4539-9fc4-fb844f2456fd tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:32:59.510891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-917f929d-a48c-4539-9fc4-fb844f2456fd tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:32:59.516940 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-917f929d-a48c-4539-9fc4-fb844f2456fd tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:59.517428 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-917f929d-a48c-4539-9fc4-fb844f2456fd tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:59.517864 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-917f929d-a48c-4539-9fc4-fb844f2456fd tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:59.518852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-917f929d-a48c-4539-9fc4-fb844f2456fd tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:32:59.519299 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-917f929d-a48c-4539-9fc4-fb844f2456fd tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:32:59.519808 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-917f929d-a48c-4539-9fc4-fb844f2456fd tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:32:59.599202 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-76505456-58ba-4a49-b690-251565b4f61d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:59.607851 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-76505456-58ba-4a49-b690-251565b4f61d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1669 microversion: 2.1 time: 0.160020 Aug 24 11:32:59.608495 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 383/780] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:59 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:32:59.661314 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-917f929d-a48c-4539-9fc4-fb844f2456fd tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:32:59.669168 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-917f929d-a48c-4539-9fc4-fb844f2456fd tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1574 microversion: 2.1 time: 0.163712 Aug 24 11:32:59.670291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 398/781] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:32:59 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:00.629036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7d027061-3ffc-4227-8c41-3472d2515460 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:00.629583 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7d027061-3ffc-4227-8c41-3472d2515460 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:00.631986 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:00.636804 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7d027061-3ffc-4227-8c41-3472d2515460 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.637284 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7d027061-3ffc-4227-8c41-3472d2515460 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.638280 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7d027061-3ffc-4227-8c41-3472d2515460 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.641898 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7d027061-3ffc-4227-8c41-3472d2515460 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.641898 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7d027061-3ffc-4227-8c41-3472d2515460 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.641898 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7d027061-3ffc-4227-8c41-3472d2515460 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.690618 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6decc7fc-cf42-446f-a63c-63bb272947ca tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:00.691334 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6decc7fc-cf42-446f-a63c-63bb272947ca tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:00.698037 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6decc7fc-cf42-446f-a63c-63bb272947ca tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.698623 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6decc7fc-cf42-446f-a63c-63bb272947ca tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.699129 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6decc7fc-cf42-446f-a63c-63bb272947ca tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.699895 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6decc7fc-cf42-446f-a63c-63bb272947ca tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:00.700923 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6decc7fc-cf42-446f-a63c-63bb272947ca tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:00.701348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6decc7fc-cf42-446f-a63c-63bb272947ca tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:00.769130 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7d027061-3ffc-4227-8c41-3472d2515460 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:00.776932 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7d027061-3ffc-4227-8c41-3472d2515460 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1669 microversion: 2.1 time: 0.151772 Aug 24 11:33:00.777512 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 384/782] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:00 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:00.834316 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6decc7fc-cf42-446f-a63c-63bb272947ca tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:00.842686 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6decc7fc-cf42-446f-a63c-63bb272947ca tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1574 microversion: 2.1 time: 0.155967 Aug 24 11:33:00.843261 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 399/783] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:00 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:01.799113 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-31f56a8d-4e70-4120-a190-fed4fddb029e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:01.799719 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-31f56a8d-4e70-4120-a190-fed4fddb029e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:01.806355 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-31f56a8d-4e70-4120-a190-fed4fddb029e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:01.806829 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-31f56a8d-4e70-4120-a190-fed4fddb029e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:01.807257 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-31f56a8d-4e70-4120-a190-fed4fddb029e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:01.807934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-31f56a8d-4e70-4120-a190-fed4fddb029e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:01.808379 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-31f56a8d-4e70-4120-a190-fed4fddb029e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:01.808794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-31f56a8d-4e70-4120-a190-fed4fddb029e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:01.864532 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6be524f4-78e1-4b63-a3f3-e33ccd1ca5d7 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:01.865152 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6be524f4-78e1-4b63-a3f3-e33ccd1ca5d7 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:01.871527 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6be524f4-78e1-4b63-a3f3-e33ccd1ca5d7 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:01.872003 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6be524f4-78e1-4b63-a3f3-e33ccd1ca5d7 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:01.872432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6be524f4-78e1-4b63-a3f3-e33ccd1ca5d7 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:01.873110 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6be524f4-78e1-4b63-a3f3-e33ccd1ca5d7 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:01.873563 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6be524f4-78e1-4b63-a3f3-e33ccd1ca5d7 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:01.874005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6be524f4-78e1-4b63-a3f3-e33ccd1ca5d7 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:01.946790 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-31f56a8d-4e70-4120-a190-fed4fddb029e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:01.954868 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-31f56a8d-4e70-4120-a190-fed4fddb029e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1669 microversion: 2.1 time: 0.159617 Aug 24 11:33:01.955456 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 385/784] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:01 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:02.009633 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6be524f4-78e1-4b63-a3f3-e33ccd1ca5d7 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:02.013810 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:02.018689 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6be524f4-78e1-4b63-a3f3-e33ccd1ca5d7 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1561 microversion: 2.1 time: 0.157783 Aug 24 11:33:02.019254 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 400/785] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:01 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:02.976982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a3eee88e-d2e4-45c1-8a5f-9752bac140cf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:02.977700 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a3eee88e-d2e4-45c1-8a5f-9752bac140cf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:02.984171 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a3eee88e-d2e4-45c1-8a5f-9752bac140cf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:02.984660 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a3eee88e-d2e4-45c1-8a5f-9752bac140cf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:02.985105 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a3eee88e-d2e4-45c1-8a5f-9752bac140cf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:02.985935 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a3eee88e-d2e4-45c1-8a5f-9752bac140cf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:02.986371 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a3eee88e-d2e4-45c1-8a5f-9752bac140cf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:02.986790 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a3eee88e-d2e4-45c1-8a5f-9752bac140cf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:03.153052 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a3eee88e-d2e4-45c1-8a5f-9752bac140cf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:03.161730 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a3eee88e-d2e4-45c1-8a5f-9752bac140cf tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1669 microversion: 2.1 time: 0.188577 Aug 24 11:33:03.173938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 386/786] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:02 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1669 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:03.505747 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-a4775437-8657-49b4-8386-0c985107d399 req-4f0ac601-e4ca-467d-a4ba-fd701ec36696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b611366f-7de9-4b85-8464-8a9b8aaed0c5", "name": "network-vif-deleted", "tag": "6c35b179-c77c-456f-b02c-0af67673cd94"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:03.505747 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-a4775437-8657-49b4-8386-0c985107d399 req-4f0ac601-e4ca-467d-a4ba-fd701ec36696 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:03.505747 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-a4775437-8657-49b4-8386-0c985107d399 req-4f0ac601-e4ca-467d-a4ba-fd701ec36696 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:03.505747 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-a4775437-8657-49b4-8386-0c985107d399 req-4f0ac601-e4ca-467d-a4ba-fd701ec36696 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:03.507153 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-a4775437-8657-49b4-8386-0c985107d399 req-4f0ac601-e4ca-467d-a4ba-fd701ec36696 service nova] Creating event network-vif-deleted:6c35b179-c77c-456f-b02c-0af67673cd94 for instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 on hv-cinder-85427 Aug 24 11:33:03.507153 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-a4775437-8657-49b4-8386-0c985107d399 req-4f0ac601-e4ca-467d-a4ba-fd701ec36696 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034621 Aug 24 11:33:03.507153 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 401/787] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:04.182755 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ecb1471a-d59b-4a49-86f3-88f423875ed0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:04.183363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ecb1471a-d59b-4a49-86f3-88f423875ed0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:04.189805 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ecb1471a-d59b-4a49-86f3-88f423875ed0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:04.190342 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ecb1471a-d59b-4a49-86f3-88f423875ed0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:04.190774 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ecb1471a-d59b-4a49-86f3-88f423875ed0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:04.191452 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ecb1471a-d59b-4a49-86f3-88f423875ed0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:04.191898 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ecb1471a-d59b-4a49-86f3-88f423875ed0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:04.192309 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ecb1471a-d59b-4a49-86f3-88f423875ed0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:04.224243 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ecb1471a-d59b-4a49-86f3-88f423875ed0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:04.225080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ecb1471a-d59b-4a49-86f3-88f423875ed0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:04.225510 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ecb1471a-d59b-4a49-86f3-88f423875ed0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:04.225981 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-ecb1471a-d59b-4a49-86f3-88f423875ed0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lazy-loading 'fault' on Instance uuid b611366f-7de9-4b85-8464-8a9b8aaed0c5 {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:04.268579 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ecb1471a-d59b-4a49-86f3-88f423875ed0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:04.276633 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ecb1471a-d59b-4a49-86f3-88f423875ed0 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 200 len: 1326 microversion: 2.1 time: 0.097601 Aug 24 11:33:04.277220 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 387/788] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:04 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:05.300046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8d14b560-e0fe-49f5-aeb5-8a3073177b21 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:05.300752 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8d14b560-e0fe-49f5-aeb5-8a3073177b21 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:05.307692 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8d14b560-e0fe-49f5-aeb5-8a3073177b21 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:05.308174 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8d14b560-e0fe-49f5-aeb5-8a3073177b21 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:05.308610 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8d14b560-e0fe-49f5-aeb5-8a3073177b21 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:05.309297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8d14b560-e0fe-49f5-aeb5-8a3073177b21 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:05.310328 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8d14b560-e0fe-49f5-aeb5-8a3073177b21 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:05.310754 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8d14b560-e0fe-49f5-aeb5-8a3073177b21 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:05.324093 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-8d14b560-e0fe-49f5-aeb5-8a3073177b21 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] HTTP exception thrown: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8d14b560-e0fe-49f5-aeb5-8a3073177b21 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Request method failure captured: Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 HTTP/1.1 Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgqCpaDBmROQ-4pnxpGvdDtMs0hYSPuU23mEUbVDYXQps29rzX_SygxCabzffIt8IdqHi8SpQMSv-yudceTB_oD56vBU20my7XIo7M-kmCKt5en23FlZly1PPX8g6AuBIHHJpfLdhZexIWSaFQ83zoAnbfpXXsze7ogC-k7NMXjFkSA Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 86e8de8aeabf4b8fa67ed0784fc39e46 Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:33:05.325926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:33:05.327601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_86e8de8aeabf4b8fa67ed0784fc39e46", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:33:05.327601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:33:05.327601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 86e8de8aeabf4b8fa67ed0784fc39e46 Aug 24 11:33:05.327601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:33:05.327601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeTestJSON-104879377-project Aug 24 11:33:05.327601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:33:05.327601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:33:05.327601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: cd79bc9c3a694fe2a4e3c645e682e438 Aug 24 11:33:05.327601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeTestJSON-104879377-project Aug 24 11:33:05.327601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:33:05.327601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:33:05.327601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': 'b611366f-7de9-4b85-8464-8a9b8aaed0c5'} Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:05.329249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:33:05.330846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:05.332752 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8d14b560-e0fe-49f5-aeb5-8a3073177b21 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Returning 404 to user: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:05.332752 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8d14b560-e0fe-49f5-aeb5-8a3073177b21 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 404 len: 111 microversion: 2.1 time: 0.032047 Aug 24 11:33:05.332752 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 402/789] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:05 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:05.336402 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-89f95655-cd2f-4c4b-a2a8-9e8ee8abc389 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '.version_select at 0x7f723ce33d30>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:05.433963 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-89f95655-cd2f-4c4b-a2a8-9e8ee8abc389 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-854208414" status: 202 len: 0 microversion: 2.1 time: 0.101064 Aug 24 11:33:05.434759 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 388/790] 10.222.0.83 () {58 vars in 1218 bytes} [Wed Aug 24 11:33:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-854208414 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:33:06.185178 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bc6d61ef-4bba-4732-b68e-f04b6f12d6c4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Action: 'create', calling method: .version_select at 0x7f723d7f20d0>, body: {"keypair": {"name": "tempest-keypair-196176851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqvdH/3jXVnHixY/N58x8fWzhQvFnYXO6R64ZIAP6Tq2CLIChTwRWoojRU+uQ7aPtruxC/ArwQQq5YzTI1adwXKpuMAIvqszLGAEgyr+WtLqU3Nv9vU/XpBNuj/2ea3IQ=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:06.201722 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-bc6d61ef-4bba-4732-b68e-f04b6f12d6c4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Getting quotas for project 86e8de8aeabf4b8fa67ed0784fc39e46. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:33:06.206248 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-bc6d61ef-4bba-4732-b68e-f04b6f12d6c4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Getting quotas for user cd79bc9c3a694fe2a4e3c645e682e438 and project 86e8de8aeabf4b8fa67ed0784fc39e46. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:33:06.323825 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bc6d61ef-4bba-4732-b68e-f04b6f12d6c4 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.143214 Aug 24 11:33:06.325069 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 403/791] 10.222.0.83 () {60 vars in 1159 bytes} [Wed Aug 24 11:33:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:08.773210 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-396596412", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21673169-bb4e-4f8c-80b8-100bd684149a"}], "security_groups": [{"name": "tempest-securitygroup--1297128288"}], "key_name": "tempest-keypair-196176851", "user_data": "}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:08.881891 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] validate_networks() for [('21673169-bb4e-4f8c-80b8-100bd684149a', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:33:09.275873 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:33:09.276304 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:33:09.276767 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:33:09.277169 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:33:09.277577 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:33:09.287386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:09.298128 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:09.298128 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:09.298128 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:09.298128 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:09.299285 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:09.308243 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Getting quotas for project 86e8de8aeabf4b8fa67ed0784fc39e46. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:33:09.312979 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Getting quotas for user cd79bc9c3a694fe2a4e3c645e682e438 and project 86e8de8aeabf4b8fa67ed0784fc39e46. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:33:09.324531 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:33:09.328004 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:33:09.521027 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-282db5c2-9ad5-4571-911d-f82acf411841 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.752151 Aug 24 11:33:09.521767 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 389/792] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:33:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:33:09.533684 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-22405cdd-74a7-49c9-9f45-53cf51cbd7f7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:09.534329 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-22405cdd-74a7-49c9-9f45-53cf51cbd7f7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:09.594571 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-22405cdd-74a7-49c9-9f45-53cf51cbd7f7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:09.603661 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-22405cdd-74a7-49c9-9f45-53cf51cbd7f7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1236 microversion: 2.1 time: 0.074283 Aug 24 11:33:09.604644 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 404/793] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:09 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:10.625439 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-aec94188-ee03-4030-83da-3b338b4a622b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:10.626116 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-aec94188-ee03-4030-83da-3b338b4a622b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:10.632340 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aec94188-ee03-4030-83da-3b338b4a622b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:10.632832 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aec94188-ee03-4030-83da-3b338b4a622b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:10.633266 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aec94188-ee03-4030-83da-3b338b4a622b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:10.634005 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aec94188-ee03-4030-83da-3b338b4a622b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:10.634460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aec94188-ee03-4030-83da-3b338b4a622b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:10.634884 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aec94188-ee03-4030-83da-3b338b4a622b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:10.700484 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-aec94188-ee03-4030-83da-3b338b4a622b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:10.711210 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-aec94188-ee03-4030-83da-3b338b4a622b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1240 microversion: 2.1 time: 0.090556 Aug 24 11:33:10.711801 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 390/794] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:10 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:11.732730 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-77880a21-d5e0-46cf-a6c1-342a94c7bb36 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:11.733287 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-77880a21-d5e0-46cf-a6c1-342a94c7bb36 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:11.740091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-77880a21-d5e0-46cf-a6c1-342a94c7bb36 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:11.740571 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-77880a21-d5e0-46cf-a6c1-342a94c7bb36 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:11.741009 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-77880a21-d5e0-46cf-a6c1-342a94c7bb36 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:11.741699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-77880a21-d5e0-46cf-a6c1-342a94c7bb36 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:11.742219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-77880a21-d5e0-46cf-a6c1-342a94c7bb36 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:11.742639 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-77880a21-d5e0-46cf-a6c1-342a94c7bb36 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:11.811490 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-77880a21-d5e0-46cf-a6c1-342a94c7bb36 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:11.819355 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-77880a21-d5e0-46cf-a6c1-342a94c7bb36 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1288 microversion: 2.1 time: 0.091284 Aug 24 11:33:11.820008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 405/795] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:11 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:12.841268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b9f0f040-3376-48c2-96c9-0984b3311a82 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:12.841923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b9f0f040-3376-48c2-96c9-0984b3311a82 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:12.848731 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b9f0f040-3376-48c2-96c9-0984b3311a82 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:12.849254 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b9f0f040-3376-48c2-96c9-0984b3311a82 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:12.849838 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b9f0f040-3376-48c2-96c9-0984b3311a82 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:12.850393 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b9f0f040-3376-48c2-96c9-0984b3311a82 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:12.850890 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b9f0f040-3376-48c2-96c9-0984b3311a82 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:12.851394 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b9f0f040-3376-48c2-96c9-0984b3311a82 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:13.056855 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b9f0f040-3376-48c2-96c9-0984b3311a82 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:13.065137 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b9f0f040-3376-48c2-96c9-0984b3311a82 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1362 microversion: 2.1 time: 0.228324 Aug 24 11:33:13.066216 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 391/796] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:12 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:13.688726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-13fe3365-4805-4f1e-a6b6-e2f4c8bddfb4 req-30a8d8aa-f81a-4afa-bf7a-85d5f8eace79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f96acf95-d040-4dac-be10-83ebe5aae8c3", "tag": "9e9b0093-ea8c-4e85-a039-f9a817c23761"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:13.699209 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-13fe3365-4805-4f1e-a6b6-e2f4c8bddfb4 req-30a8d8aa-f81a-4afa-bf7a-85d5f8eace79 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:13.699209 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-13fe3365-4805-4f1e-a6b6-e2f4c8bddfb4 req-30a8d8aa-f81a-4afa-bf7a-85d5f8eace79 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:13.699764 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-13fe3365-4805-4f1e-a6b6-e2f4c8bddfb4 req-30a8d8aa-f81a-4afa-bf7a-85d5f8eace79 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:13.712363 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-13fe3365-4805-4f1e-a6b6-e2f4c8bddfb4 req-30a8d8aa-f81a-4afa-bf7a-85d5f8eace79 service nova] Creating event network-changed:9e9b0093-ea8c-4e85-a039-f9a817c23761 for instance f96acf95-d040-4dac-be10-83ebe5aae8c3 on hv-cinder-85427 Aug 24 11:33:13.718181 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-13fe3365-4805-4f1e-a6b6-e2f4c8bddfb4 req-30a8d8aa-f81a-4afa-bf7a-85d5f8eace79 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034937 Aug 24 11:33:13.718797 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 406/797] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:14.086842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7a264bbe-ed60-4591-9f17-9c5d64da9c48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:14.087621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7a264bbe-ed60-4591-9f17-9c5d64da9c48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:14.095910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7a264bbe-ed60-4591-9f17-9c5d64da9c48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:14.096400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7a264bbe-ed60-4591-9f17-9c5d64da9c48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:14.096866 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7a264bbe-ed60-4591-9f17-9c5d64da9c48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:14.097577 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7a264bbe-ed60-4591-9f17-9c5d64da9c48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:14.098062 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7a264bbe-ed60-4591-9f17-9c5d64da9c48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:14.098487 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7a264bbe-ed60-4591-9f17-9c5d64da9c48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:14.319385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7a264bbe-ed60-4591-9f17-9c5d64da9c48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:14.328051 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7a264bbe-ed60-4591-9f17-9c5d64da9c48 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1362 microversion: 2.1 time: 0.245039 Aug 24 11:33:14.328648 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 392/798] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:14 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:15.349641 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-265a622b-62c2-4fdc-884f-53a28fcde96a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:15.350648 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-265a622b-62c2-4fdc-884f-53a28fcde96a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:15.359416 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-265a622b-62c2-4fdc-884f-53a28fcde96a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:15.360088 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-265a622b-62c2-4fdc-884f-53a28fcde96a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:15.360706 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-265a622b-62c2-4fdc-884f-53a28fcde96a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:15.361689 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-265a622b-62c2-4fdc-884f-53a28fcde96a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:15.362410 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-265a622b-62c2-4fdc-884f-53a28fcde96a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:15.363016 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-265a622b-62c2-4fdc-884f-53a28fcde96a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:15.492737 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-265a622b-62c2-4fdc-884f-53a28fcde96a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:15.500945 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-265a622b-62c2-4fdc-884f-53a28fcde96a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1362 microversion: 2.1 time: 0.156048 Aug 24 11:33:15.501500 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 407/799] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:15 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:16.270715 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f1cacdf3-f0e3-4d9d-af78-e1d360f6a316 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:16.271203 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f1cacdf3-f0e3-4d9d-af78-e1d360f6a316 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:16.277661 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1cacdf3-f0e3-4d9d-af78-e1d360f6a316 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.278196 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1cacdf3-f0e3-4d9d-af78-e1d360f6a316 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.278633 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1cacdf3-f0e3-4d9d-af78-e1d360f6a316 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.279319 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1cacdf3-f0e3-4d9d-af78-e1d360f6a316 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.279953 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1cacdf3-f0e3-4d9d-af78-e1d360f6a316 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.280376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1cacdf3-f0e3-4d9d-af78-e1d360f6a316 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.362219 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-f1cacdf3-f0e3-4d9d-af78-e1d360f6a316 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lazy-loading 'services' on Instance uuid c2aa046f-53cb-4392-9270-8f1d3b977f16 {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:16.522878 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7381a26e-267e-4c0a-a382-964a1e516242 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:16.523464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7381a26e-267e-4c0a-a382-964a1e516242 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:16.531101 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7381a26e-267e-4c0a-a382-964a1e516242 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.531596 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7381a26e-267e-4c0a-a382-964a1e516242 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.532043 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7381a26e-267e-4c0a-a382-964a1e516242 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.533666 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7381a26e-267e-4c0a-a382-964a1e516242 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.534157 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7381a26e-267e-4c0a-a382-964a1e516242 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.534588 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7381a26e-267e-4c0a-a382-964a1e516242 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.534786 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f1cacdf3-f0e3-4d9d-af78-e1d360f6a316 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments/68b5d87e-8649-4c53-b213-006af94cca73" status: 202 len: 0 microversion: 2.1 time: 0.267748 Aug 24 11:33:16.535448 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 393/800] 10.222.0.83 () {58 vars in 1416 bytes} [Wed Aug 24 11:33:16 2022] DELETE /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments/68b5d87e-8649-4c53-b213-006af94cca73 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:33:16.544533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8d73db7b-4497-429e-9194-f6424e495932 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:16.546870 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8d73db7b-4497-429e-9194-f6424e495932 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:16.553422 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8d73db7b-4497-429e-9194-f6424e495932 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.554085 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8d73db7b-4497-429e-9194-f6424e495932 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.562064 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8d73db7b-4497-429e-9194-f6424e495932 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.562064 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8d73db7b-4497-429e-9194-f6424e495932 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:16.562064 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8d73db7b-4497-429e-9194-f6424e495932 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:16.562064 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8d73db7b-4497-429e-9194-f6424e495932 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:16.592207 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8d73db7b-4497-429e-9194-f6424e495932 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051768 Aug 24 11:33:16.592779 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 394/801] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:16 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:33:16.666702 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7381a26e-267e-4c0a-a382-964a1e516242 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:16.674415 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7381a26e-267e-4c0a-a382-964a1e516242 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1362 microversion: 2.1 time: 0.155543 Aug 24 11:33:16.674983 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 408/802] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:16 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:17.604085 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-fa709f83-7430-4a9c-b257-d1610332d186 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:17.606215 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-fa709f83-7430-4a9c-b257-d1610332d186 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:17.612679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fa709f83-7430-4a9c-b257-d1610332d186 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:17.613170 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fa709f83-7430-4a9c-b257-d1610332d186 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:17.613597 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fa709f83-7430-4a9c-b257-d1610332d186 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:17.614315 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fa709f83-7430-4a9c-b257-d1610332d186 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:17.614764 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fa709f83-7430-4a9c-b257-d1610332d186 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:17.615183 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fa709f83-7430-4a9c-b257-d1610332d186 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:17.641200 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:17.646155 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-fa709f83-7430-4a9c-b257-d1610332d186 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046161 Aug 24 11:33:17.646760 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 395/803] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:17 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:17.695427 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4381469c-af11-4e30-ae07-27ebe64f023d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:17.696046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4381469c-af11-4e30-ae07-27ebe64f023d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:17.703033 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4381469c-af11-4e30-ae07-27ebe64f023d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:17.703520 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4381469c-af11-4e30-ae07-27ebe64f023d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:17.703962 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4381469c-af11-4e30-ae07-27ebe64f023d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:17.704657 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4381469c-af11-4e30-ae07-27ebe64f023d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:17.705119 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4381469c-af11-4e30-ae07-27ebe64f023d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:17.705543 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4381469c-af11-4e30-ae07-27ebe64f023d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:17.835631 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4381469c-af11-4e30-ae07-27ebe64f023d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:17.844064 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4381469c-af11-4e30-ae07-27ebe64f023d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1362 microversion: 2.1 time: 0.152216 Aug 24 11:33:17.844900 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 409/804] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:17 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:18.659381 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0c96c935-06b6-4757-ad47-c46c2b0ca878 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:18.661522 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0c96c935-06b6-4757-ad47-c46c2b0ca878 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:18.669624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c96c935-06b6-4757-ad47-c46c2b0ca878 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:18.670153 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c96c935-06b6-4757-ad47-c46c2b0ca878 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:18.670591 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c96c935-06b6-4757-ad47-c46c2b0ca878 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:18.671342 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c96c935-06b6-4757-ad47-c46c2b0ca878 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:18.671794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c96c935-06b6-4757-ad47-c46c2b0ca878 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:18.672217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c96c935-06b6-4757-ad47-c46c2b0ca878 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:18.704590 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0c96c935-06b6-4757-ad47-c46c2b0ca878 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049065 Aug 24 11:33:18.705077 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 396/805] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:18 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:33:18.864894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7bee3b0f-b377-4b13-ab30-9d23f458db39 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:18.865492 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7bee3b0f-b377-4b13-ab30-9d23f458db39 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:18.872147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bee3b0f-b377-4b13-ab30-9d23f458db39 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:18.872641 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bee3b0f-b377-4b13-ab30-9d23f458db39 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:18.874828 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bee3b0f-b377-4b13-ab30-9d23f458db39 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:18.874828 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bee3b0f-b377-4b13-ab30-9d23f458db39 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:18.874828 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bee3b0f-b377-4b13-ab30-9d23f458db39 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:18.874828 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bee3b0f-b377-4b13-ab30-9d23f458db39 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:19.008727 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7bee3b0f-b377-4b13-ab30-9d23f458db39 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:19.018368 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7bee3b0f-b377-4b13-ab30-9d23f458db39 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1362 microversion: 2.1 time: 0.157338 Aug 24 11:33:19.018952 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 410/806] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:18 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:19.717257 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-fc6c846f-5f2a-4b25-9258-d27925d138f1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:19.719397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-fc6c846f-5f2a-4b25-9258-d27925d138f1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:19.721268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:19.721997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=6 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:19.727400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc6c846f-5f2a-4b25-9258-d27925d138f1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:19.727937 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc6c846f-5f2a-4b25-9258-d27925d138f1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:19.734405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc6c846f-5f2a-4b25-9258-d27925d138f1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:19.734405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc6c846f-5f2a-4b25-9258-d27925d138f1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:19.734405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc6c846f-5f2a-4b25-9258-d27925d138f1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:19.734405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fc6c846f-5f2a-4b25-9258-d27925d138f1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:19.760219 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-fc6c846f-5f2a-4b25-9258-d27925d138f1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047416 Aug 24 11:33:19.763148 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 397/807] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:19 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:33:19.838960 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b6327b55-87c9-4055-b367-d66b6dd3bfc8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:19.839463 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b6327b55-87c9-4055-b367-d66b6dd3bfc8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:19.841955 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:19.846732 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6327b55-87c9-4055-b367-d66b6dd3bfc8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:19.847219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6327b55-87c9-4055-b367-d66b6dd3bfc8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:19.848182 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6327b55-87c9-4055-b367-d66b6dd3bfc8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:19.848344 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6327b55-87c9-4055-b367-d66b6dd3bfc8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:19.848798 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6327b55-87c9-4055-b367-d66b6dd3bfc8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:19.849224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6327b55-87c9-4055-b367-d66b6dd3bfc8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:19.875563 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b6327b55-87c9-4055-b367-d66b6dd3bfc8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:33:20.038957 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4df97b71-215f-4071-93b9-64bf8ace1c73 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:20.039561 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4df97b71-215f-4071-93b9-64bf8ace1c73 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:20.045916 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4df97b71-215f-4071-93b9-64bf8ace1c73 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:20.046406 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4df97b71-215f-4071-93b9-64bf8ace1c73 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:20.046866 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4df97b71-215f-4071-93b9-64bf8ace1c73 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:20.047887 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4df97b71-215f-4071-93b9-64bf8ace1c73 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:20.048008 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4df97b71-215f-4071-93b9-64bf8ace1c73 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:20.048395 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4df97b71-215f-4071-93b9-64bf8ace1c73 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:20.184373 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4df97b71-215f-4071-93b9-64bf8ace1c73 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:20.190370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b6327b55-87c9-4055-b367-d66b6dd3bfc8 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 204 len: 0 microversion: 2.1 time: 0.354976 Aug 24 11:33:20.191131 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 411/808] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:33:19 2022] DELETE /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:20.199889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4df97b71-215f-4071-93b9-64bf8ace1c73 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1362 microversion: 2.1 time: 0.159047 Aug 24 11:33:20.199889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 398/809] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:20 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:20.200124 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-78ddd725-aa2f-4ae6-a95b-48c59148ff9f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:20.200579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-78ddd725-aa2f-4ae6-a95b-48c59148ff9f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:20.206533 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78ddd725-aa2f-4ae6-a95b-48c59148ff9f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:20.206997 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78ddd725-aa2f-4ae6-a95b-48c59148ff9f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:20.207432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78ddd725-aa2f-4ae6-a95b-48c59148ff9f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:20.208115 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78ddd725-aa2f-4ae6-a95b-48c59148ff9f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:20.208564 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78ddd725-aa2f-4ae6-a95b-48c59148ff9f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:20.208981 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78ddd725-aa2f-4ae6-a95b-48c59148ff9f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:20.345974 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-78ddd725-aa2f-4ae6-a95b-48c59148ff9f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:20.354076 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-78ddd725-aa2f-4ae6-a95b-48c59148ff9f tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1688 microversion: 2.1 time: 0.158619 Aug 24 11:33:20.354635 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 412/810] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:20 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:20.596904 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-1e284113-e343-40fa-ae45-a0b08b4c360f req-ed010fde-92c0-40ae-bd8a-e6ed9df115b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96acf95-d040-4dac-be10-83ebe5aae8c3", "name": "network-vif-plugged", "status": "completed", "tag": "9e9b0093-ea8c-4e85-a039-f9a817c23761"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:20.606925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-1e284113-e343-40fa-ae45-a0b08b4c360f req-ed010fde-92c0-40ae-bd8a-e6ed9df115b4 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:20.607404 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-1e284113-e343-40fa-ae45-a0b08b4c360f req-ed010fde-92c0-40ae-bd8a-e6ed9df115b4 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:20.608367 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-1e284113-e343-40fa-ae45-a0b08b4c360f req-ed010fde-92c0-40ae-bd8a-e6ed9df115b4 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:20.619328 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-1e284113-e343-40fa-ae45-a0b08b4c360f req-ed010fde-92c0-40ae-bd8a-e6ed9df115b4 service nova] Creating event network-vif-plugged:9e9b0093-ea8c-4e85-a039-f9a817c23761 for instance f96acf95-d040-4dac-be10-83ebe5aae8c3 on hv-cinder-85427 Aug 24 11:33:20.625144 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-1e284113-e343-40fa-ae45-a0b08b4c360f req-ed010fde-92c0-40ae-bd8a-e6ed9df115b4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031926 Aug 24 11:33:20.625762 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 399/811] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:21.215406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8a0a8097-2065-414f-bfe3-2617d1a9714e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:21.215947 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8a0a8097-2065-414f-bfe3-2617d1a9714e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:21.222328 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a0a8097-2065-414f-bfe3-2617d1a9714e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:21.222832 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a0a8097-2065-414f-bfe3-2617d1a9714e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:21.223286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a0a8097-2065-414f-bfe3-2617d1a9714e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:21.223961 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a0a8097-2065-414f-bfe3-2617d1a9714e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:21.224407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a0a8097-2065-414f-bfe3-2617d1a9714e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:21.224822 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a0a8097-2065-414f-bfe3-2617d1a9714e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:21.353847 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8a0a8097-2065-414f-bfe3-2617d1a9714e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:21.361528 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8a0a8097-2065-414f-bfe3-2617d1a9714e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1362 microversion: 2.1 time: 0.150088 Aug 24 11:33:21.362131 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 413/812] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:21 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:21.376174 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f9a26bdc-fb66-4ca7-91c9-84cc3ef37645 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:21.376872 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f9a26bdc-fb66-4ca7-91c9-84cc3ef37645 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:21.383032 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f9a26bdc-fb66-4ca7-91c9-84cc3ef37645 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:21.383517 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f9a26bdc-fb66-4ca7-91c9-84cc3ef37645 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:21.383952 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f9a26bdc-fb66-4ca7-91c9-84cc3ef37645 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:21.384642 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f9a26bdc-fb66-4ca7-91c9-84cc3ef37645 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:21.385099 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f9a26bdc-fb66-4ca7-91c9-84cc3ef37645 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:21.385514 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f9a26bdc-fb66-4ca7-91c9-84cc3ef37645 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:21.515611 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f9a26bdc-fb66-4ca7-91c9-84cc3ef37645 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:21.523650 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f9a26bdc-fb66-4ca7-91c9-84cc3ef37645 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1688 microversion: 2.1 time: 0.152649 Aug 24 11:33:21.524223 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 400/813] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:21 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:22.383179 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c4f82068-3e3c-473c-8198-5189d4beced3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:22.383780 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c4f82068-3e3c-473c-8198-5189d4beced3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:22.390291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c4f82068-3e3c-473c-8198-5189d4beced3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:22.390779 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c4f82068-3e3c-473c-8198-5189d4beced3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:22.391218 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c4f82068-3e3c-473c-8198-5189d4beced3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:22.391911 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c4f82068-3e3c-473c-8198-5189d4beced3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:22.392625 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c4f82068-3e3c-473c-8198-5189d4beced3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:22.393049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c4f82068-3e3c-473c-8198-5189d4beced3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:22.526050 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c4f82068-3e3c-473c-8198-5189d4beced3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:22.534607 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c4f82068-3e3c-473c-8198-5189d4beced3 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1362 microversion: 2.1 time: 0.155386 Aug 24 11:33:22.535211 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 414/814] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:22 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:22.544418 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d7313207-bb14-44d3-9445-373a41f71fce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:22.545037 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d7313207-bb14-44d3-9445-373a41f71fce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:22.551501 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d7313207-bb14-44d3-9445-373a41f71fce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:22.551985 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d7313207-bb14-44d3-9445-373a41f71fce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:22.552423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d7313207-bb14-44d3-9445-373a41f71fce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:22.553121 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d7313207-bb14-44d3-9445-373a41f71fce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:22.553578 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d7313207-bb14-44d3-9445-373a41f71fce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:22.554043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d7313207-bb14-44d3-9445-373a41f71fce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:22.686714 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d7313207-bb14-44d3-9445-373a41f71fce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:22.694660 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d7313207-bb14-44d3-9445-373a41f71fce tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1688 microversion: 2.1 time: 0.154076 Aug 24 11:33:22.695232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 401/815] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:22 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:23.555114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dc06bf91-988f-408c-b80f-f697a7553d6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:23.555633 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-dc06bf91-988f-408c-b80f-f697a7553d6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:23.562079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc06bf91-988f-408c-b80f-f697a7553d6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:23.562562 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc06bf91-988f-408c-b80f-f697a7553d6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:23.562994 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc06bf91-988f-408c-b80f-f697a7553d6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:23.563680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc06bf91-988f-408c-b80f-f697a7553d6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:23.564143 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc06bf91-988f-408c-b80f-f697a7553d6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:23.564561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc06bf91-988f-408c-b80f-f697a7553d6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:23.690322 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dc06bf91-988f-408c-b80f-f697a7553d6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:23.697950 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-dc06bf91-988f-408c-b80f-f697a7553d6d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1362 microversion: 2.1 time: 0.146771 Aug 24 11:33:23.698513 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 415/816] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:23 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:23.716092 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-632f9fd8-9855-41d8-ad2d-28db4bee4c19 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:23.716740 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-632f9fd8-9855-41d8-ad2d-28db4bee4c19 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:23.723259 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-632f9fd8-9855-41d8-ad2d-28db4bee4c19 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:23.723776 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-632f9fd8-9855-41d8-ad2d-28db4bee4c19 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:23.724213 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-632f9fd8-9855-41d8-ad2d-28db4bee4c19 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:23.724903 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-632f9fd8-9855-41d8-ad2d-28db4bee4c19 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:23.725358 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-632f9fd8-9855-41d8-ad2d-28db4bee4c19 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:23.725783 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-632f9fd8-9855-41d8-ad2d-28db4bee4c19 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:23.861718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-632f9fd8-9855-41d8-ad2d-28db4bee4c19 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:23.869606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-632f9fd8-9855-41d8-ad2d-28db4bee4c19 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1688 microversion: 2.1 time: 0.157892 Aug 24 11:33:23.870227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 402/817] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:23 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:24.718627 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3b2a4033-f364-4d5b-a2cf-3388864f5894 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:24.719244 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3b2a4033-f364-4d5b-a2cf-3388864f5894 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:24.725954 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3b2a4033-f364-4d5b-a2cf-3388864f5894 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:24.726392 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3b2a4033-f364-4d5b-a2cf-3388864f5894 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:24.726824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3b2a4033-f364-4d5b-a2cf-3388864f5894 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:24.727514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3b2a4033-f364-4d5b-a2cf-3388864f5894 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:24.727963 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3b2a4033-f364-4d5b-a2cf-3388864f5894 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:24.728434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3b2a4033-f364-4d5b-a2cf-3388864f5894 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:24.859483 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3b2a4033-f364-4d5b-a2cf-3388864f5894 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:24.867158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3b2a4033-f364-4d5b-a2cf-3388864f5894 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1362 microversion: 2.1 time: 0.152425 Aug 24 11:33:24.868063 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 416/818] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:24 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:24.890752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b6bcd629-15bb-499b-8842-105c127a09c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:24.891367 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b6bcd629-15bb-499b-8842-105c127a09c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:24.898174 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b6bcd629-15bb-499b-8842-105c127a09c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:24.898661 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b6bcd629-15bb-499b-8842-105c127a09c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:24.899101 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b6bcd629-15bb-499b-8842-105c127a09c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:24.899797 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b6bcd629-15bb-499b-8842-105c127a09c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:24.900270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b6bcd629-15bb-499b-8842-105c127a09c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:24.900675 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b6bcd629-15bb-499b-8842-105c127a09c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:25.032027 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b6bcd629-15bb-499b-8842-105c127a09c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:25.039635 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b6bcd629-15bb-499b-8842-105c127a09c9 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1688 microversion: 2.1 time: 0.153224 Aug 24 11:33:25.040210 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 403/819] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:24 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:25.888022 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c6525f7c-dce7-4c6b-9551-9355f178d5d6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:25.888689 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c6525f7c-dce7-4c6b-9551-9355f178d5d6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:25.895555 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c6525f7c-dce7-4c6b-9551-9355f178d5d6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:25.896041 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c6525f7c-dce7-4c6b-9551-9355f178d5d6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:25.896476 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c6525f7c-dce7-4c6b-9551-9355f178d5d6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:25.897174 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c6525f7c-dce7-4c6b-9551-9355f178d5d6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:25.897630 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c6525f7c-dce7-4c6b-9551-9355f178d5d6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:25.898087 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c6525f7c-dce7-4c6b-9551-9355f178d5d6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:26.037459 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c6525f7c-dce7-4c6b-9551-9355f178d5d6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:26.045045 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c6525f7c-dce7-4c6b-9551-9355f178d5d6 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1362 microversion: 2.1 time: 0.161181 Aug 24 11:33:26.045610 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 417/820] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:25 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:26.060323 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-cdb4b6d1-3435-4fe3-b276-853ce8194514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:26.060935 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-cdb4b6d1-3435-4fe3-b276-853ce8194514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:26.067357 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cdb4b6d1-3435-4fe3-b276-853ce8194514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:26.068306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cdb4b6d1-3435-4fe3-b276-853ce8194514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:26.068306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cdb4b6d1-3435-4fe3-b276-853ce8194514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:26.068944 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cdb4b6d1-3435-4fe3-b276-853ce8194514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:26.069397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cdb4b6d1-3435-4fe3-b276-853ce8194514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:26.069819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cdb4b6d1-3435-4fe3-b276-853ce8194514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:26.295100 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-cdb4b6d1-3435-4fe3-b276-853ce8194514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:26.303066 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-cdb4b6d1-3435-4fe3-b276-853ce8194514 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1688 microversion: 2.1 time: 0.246592 Aug 24 11:33:26.303657 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 404/821] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:26 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:27.004316 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-37f9c19f-4b9f-4924-9e12-2f73735c69cd req-c5c8ac29-7f33-41b8-8245-07bbd69138df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2aa046f-53cb-4392-9270-8f1d3b977f16", "name": "network-vif-deleted", "tag": "1cedc0c3-0dae-4b5b-88b5-558ae772865a"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:27.014262 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-37f9c19f-4b9f-4924-9e12-2f73735c69cd req-c5c8ac29-7f33-41b8-8245-07bbd69138df service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:27.014733 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-37f9c19f-4b9f-4924-9e12-2f73735c69cd req-c5c8ac29-7f33-41b8-8245-07bbd69138df service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:27.015163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-37f9c19f-4b9f-4924-9e12-2f73735c69cd req-c5c8ac29-7f33-41b8-8245-07bbd69138df service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:27.026668 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-37f9c19f-4b9f-4924-9e12-2f73735c69cd req-c5c8ac29-7f33-41b8-8245-07bbd69138df service nova] Creating event network-vif-deleted:1cedc0c3-0dae-4b5b-88b5-558ae772865a for instance c2aa046f-53cb-4392-9270-8f1d3b977f16 on hv-cinder-85427 Aug 24 11:33:27.031666 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-37f9c19f-4b9f-4924-9e12-2f73735c69cd req-c5c8ac29-7f33-41b8-8245-07bbd69138df service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030878 Aug 24 11:33:27.032139 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 418/822] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:27.065710 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-de6598e6-9aaf-4c27-80d1-b7be458f720d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:27.066466 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-de6598e6-9aaf-4c27-80d1-b7be458f720d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:27.073097 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-de6598e6-9aaf-4c27-80d1-b7be458f720d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:27.073677 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-de6598e6-9aaf-4c27-80d1-b7be458f720d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:27.074587 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-de6598e6-9aaf-4c27-80d1-b7be458f720d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:27.075375 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-de6598e6-9aaf-4c27-80d1-b7be458f720d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:27.075906 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-de6598e6-9aaf-4c27-80d1-b7be458f720d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:27.076404 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-de6598e6-9aaf-4c27-80d1-b7be458f720d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:27.229281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-de6598e6-9aaf-4c27-80d1-b7be458f720d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:27.242385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-de6598e6-9aaf-4c27-80d1-b7be458f720d tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1547 microversion: 2.1 time: 0.180527 Aug 24 11:33:27.249967 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 405/823] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:27 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1547 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:27.266780 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6fc8ccf6-60b4-47bd-949c-7a64c8a1e537 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:27.267637 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6fc8ccf6-60b4-47bd-949c-7a64c8a1e537 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:27.270668 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:27.274598 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6fc8ccf6-60b4-47bd-949c-7a64c8a1e537 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:27.275093 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6fc8ccf6-60b4-47bd-949c-7a64c8a1e537 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:27.275532 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6fc8ccf6-60b4-47bd-949c-7a64c8a1e537 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:27.276232 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6fc8ccf6-60b4-47bd-949c-7a64c8a1e537 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:27.276686 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6fc8ccf6-60b4-47bd-949c-7a64c8a1e537 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:27.277645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6fc8ccf6-60b4-47bd-949c-7a64c8a1e537 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:27.328742 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-af1e68db-9b78-4f02-a5fb-201c2ec4f33c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:27.329256 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-af1e68db-9b78-4f02-a5fb-201c2ec4f33c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:27.335505 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-af1e68db-9b78-4f02-a5fb-201c2ec4f33c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:27.338889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-af1e68db-9b78-4f02-a5fb-201c2ec4f33c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:27.338889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-af1e68db-9b78-4f02-a5fb-201c2ec4f33c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:27.338889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-af1e68db-9b78-4f02-a5fb-201c2ec4f33c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:27.338889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-af1e68db-9b78-4f02-a5fb-201c2ec4f33c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:27.339292 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-af1e68db-9b78-4f02-a5fb-201c2ec4f33c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:27.375781 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6fc8ccf6-60b4-47bd-949c-7a64c8a1e537 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113247 Aug 24 11:33:27.376384 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 419/824] 10.222.0.83 () {58 vars in 1275 bytes} [Wed Aug 24 11:33:27 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:27.411774 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-af1e68db-9b78-4f02-a5fb-201c2ec4f33c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:27.420821 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-af1e68db-9b78-4f02-a5fb-201c2ec4f33c tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 200 len: 1621 microversion: 2.1 time: 0.100916 Aug 24 11:33:27.426688 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 406/825] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:27 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 1621 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:28.443718 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3e92035d-3df0-435f-bed3-fecbfc29d11d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:28.445065 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3e92035d-3df0-435f-bed3-fecbfc29d11d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: c2aa046f-53cb-4392-9270-8f1d3b977f16] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:28.451996 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3e92035d-3df0-435f-bed3-fecbfc29d11d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:28.452487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3e92035d-3df0-435f-bed3-fecbfc29d11d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:28.452924 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3e92035d-3df0-435f-bed3-fecbfc29d11d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:28.453632 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3e92035d-3df0-435f-bed3-fecbfc29d11d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:28.454162 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3e92035d-3df0-435f-bed3-fecbfc29d11d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:28.454719 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3e92035d-3df0-435f-bed3-fecbfc29d11d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:28.470213 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-3e92035d-3df0-435f-bed3-fecbfc29d11d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] HTTP exception thrown: Instance c2aa046f-53cb-4392-9270-8f1d3b977f16 could not be found. Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3e92035d-3df0-435f-bed3-fecbfc29d11d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Request method failure captured: Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 HTTP/1.1 Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgsA8Jn_BUXkOSSf-IXqjq3ClFLYqNACLutdEq5Ij1NsviZ-h751UGnirP3f1ukDzGHkrgVXnxtFPib47w8CdDod3TnqCh2kVL57Xs2-fzXXISHIUuF_FZW58616j9CbFCbND1btJXqiSIS_4nJdx7k-0ePa33Pu5vyClvgN35VuW6o Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: e2a13f3ca60643a9a3507476325d351a Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:33:28.471884 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:33:28.473579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e2a13f3ca60643a9a3507476325d351a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:33:28.473579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:33:28.473579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: e2a13f3ca60643a9a3507476325d351a Aug 24 11:33:28.473579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:33:28.473579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-ServerRescueNegativeTestJSON-1136194767-project Aug 24 11:33:28.473579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:33:28.473579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:33:28.473579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 57be68e76fc14d2ca309571e284509bd Aug 24 11:33:28.473579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1136194767-project Aug 24 11:33:28.473579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:33:28.473579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance c2aa046f-53cb-4392-9270-8f1d3b977f16 could not be found. Aug 24 11:33:28.473579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': 'c2aa046f-53cb-4392-9270-8f1d3b977f16'} Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2aa046f-53cb-4392-9270-8f1d3b977f16 could not be found. Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:28.474561 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2aa046f-53cb-4392-9270-8f1d3b977f16 could not be found. Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2aa046f-53cb-4392-9270-8f1d3b977f16 could not be found. Aug 24 11:33:28.476848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:28.482498 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3e92035d-3df0-435f-bed3-fecbfc29d11d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Returning 404 to user: Instance c2aa046f-53cb-4392-9270-8f1d3b977f16 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:28.482498 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3e92035d-3df0-435f-bed3-fecbfc29d11d tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16" status: 404 len: 111 microversion: 2.1 time: 0.034402 Aug 24 11:33:28.482498 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 420/826] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:28 2022] GET /compute/v2.1/servers/c2aa046f-53cb-4392-9270-8f1d3b977f16 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:28.484099 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d8aad2d9-12ad-4c7d-b17f-b7dbd340bdbf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '.version_select at 0x7f723cfec5e0>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:28.623022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d8aad2d9-12ad-4c7d-b17f-b7dbd340bdbf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-37681819" status: 202 len: 0 microversion: 2.1 time: 0.143717 Aug 24 11:33:28.624618 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 407/827] 10.222.0.83 () {58 vars in 1215 bytes} [Wed Aug 24 11:33:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-37681819 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:33:28.637665 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-11f189ef-2bc6-4ce4-8925-f0f37befa0fd req-8ecd0ff0-a7e9-4440-ad96-0fac0c5be74d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f96acf95-d040-4dac-be10-83ebe5aae8c3", "tag": "9e9b0093-ea8c-4e85-a039-f9a817c23761"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:28.647296 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-11f189ef-2bc6-4ce4-8925-f0f37befa0fd req-8ecd0ff0-a7e9-4440-ad96-0fac0c5be74d service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:28.647970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-11f189ef-2bc6-4ce4-8925-f0f37befa0fd req-8ecd0ff0-a7e9-4440-ad96-0fac0c5be74d service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:28.648221 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-11f189ef-2bc6-4ce4-8925-f0f37befa0fd req-8ecd0ff0-a7e9-4440-ad96-0fac0c5be74d service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:28.661428 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-11f189ef-2bc6-4ce4-8925-f0f37befa0fd req-8ecd0ff0-a7e9-4440-ad96-0fac0c5be74d service nova] Creating event network-changed:9e9b0093-ea8c-4e85-a039-f9a817c23761 for instance f96acf95-d040-4dac-be10-83ebe5aae8c3 on hv-cinder-85427 Aug 24 11:33:28.667011 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-11f189ef-2bc6-4ce4-8925-f0f37befa0fd req-8ecd0ff0-a7e9-4440-ad96-0fac0c5be74d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033502 Aug 24 11:33:28.675138 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 421/828] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:32.042333 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e44e7ffb-4a98-497c-ac85-880ce073eccf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:32.042831 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e44e7ffb-4a98-497c-ac85-880ce073eccf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:32.044712 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:32.050347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e44e7ffb-4a98-497c-ac85-880ce073eccf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:32.050829 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e44e7ffb-4a98-497c-ac85-880ce073eccf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:32.051260 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e44e7ffb-4a98-497c-ac85-880ce073eccf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:32.051938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e44e7ffb-4a98-497c-ac85-880ce073eccf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:32.052422 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e44e7ffb-4a98-497c-ac85-880ce073eccf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:32.052800 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e44e7ffb-4a98-497c-ac85-880ce073eccf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:32.077694 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e44e7ffb-4a98-497c-ac85-880ce073eccf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Going to try to terminate instance {{(pid=121222) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:33:32.423947 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e44e7ffb-4a98-497c-ac85-880ce073eccf tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "DELETE /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 204 len: 0 microversion: 2.1 time: 0.385630 Aug 24 11:33:32.424560 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 408/829] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:33:32 2022] DELETE /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:32.434215 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-212060ac-6616-44aa-ba80-fda91c35acc2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:32.434925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-212060ac-6616-44aa-ba80-fda91c35acc2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:32.441375 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-212060ac-6616-44aa-ba80-fda91c35acc2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:32.441862 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-212060ac-6616-44aa-ba80-fda91c35acc2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:32.442341 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-212060ac-6616-44aa-ba80-fda91c35acc2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:32.443033 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-212060ac-6616-44aa-ba80-fda91c35acc2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:32.443490 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-212060ac-6616-44aa-ba80-fda91c35acc2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:32.443915 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-212060ac-6616-44aa-ba80-fda91c35acc2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:32.450566 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:32.577948 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-212060ac-6616-44aa-ba80-fda91c35acc2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:32.583310 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-212060ac-6616-44aa-ba80-fda91c35acc2 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1508 microversion: 2.1 time: 0.154447 Aug 24 11:33:32.583887 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 422/830] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:32 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:33.604756 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-32d0949d-e321-42d2-ad61-dab9a238bd85 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:33.605381 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-32d0949d-e321-42d2-ad61-dab9a238bd85 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:33.611925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-32d0949d-e321-42d2-ad61-dab9a238bd85 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:33.612437 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-32d0949d-e321-42d2-ad61-dab9a238bd85 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:33.612957 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-32d0949d-e321-42d2-ad61-dab9a238bd85 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:33.613665 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-32d0949d-e321-42d2-ad61-dab9a238bd85 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:33.614147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-32d0949d-e321-42d2-ad61-dab9a238bd85 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:33.614568 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-32d0949d-e321-42d2-ad61-dab9a238bd85 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:33.829046 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-32d0949d-e321-42d2-ad61-dab9a238bd85 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:33.837455 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-32d0949d-e321-42d2-ad61-dab9a238bd85 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1508 microversion: 2.1 time: 0.237063 Aug 24 11:33:33.838071 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 409/831] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:33 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:34.468836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-13f16d1d-b864-47f6-9cf8-0713a8416d7c req-b60e658f-9d5a-4f64-b55f-ec1b6c6925db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686e0b3f-da08-4b12-b376-c7f3f88474b8", "name": "network-vif-deleted", "tag": "6ee951d1-6e63-41c2-9f51-717bd126d0f5"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:34.479319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-13f16d1d-b864-47f6-9cf8-0713a8416d7c req-b60e658f-9d5a-4f64-b55f-ec1b6c6925db service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:34.480392 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-13f16d1d-b864-47f6-9cf8-0713a8416d7c req-b60e658f-9d5a-4f64-b55f-ec1b6c6925db service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:34.480755 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-13f16d1d-b864-47f6-9cf8-0713a8416d7c req-b60e658f-9d5a-4f64-b55f-ec1b6c6925db service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:34.493949 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-13f16d1d-b864-47f6-9cf8-0713a8416d7c req-b60e658f-9d5a-4f64-b55f-ec1b6c6925db service nova] Creating event network-vif-deleted:6ee951d1-6e63-41c2-9f51-717bd126d0f5 for instance 686e0b3f-da08-4b12-b376-c7f3f88474b8 on hv-cinder-85427 Aug 24 11:33:34.501586 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-13f16d1d-b864-47f6-9cf8-0713a8416d7c req-b60e658f-9d5a-4f64-b55f-ec1b6c6925db service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034843 Aug 24 11:33:34.501586 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 423/832] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:34.858837 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-97523eb5-22aa-45b6-b24d-e75bd9f742e1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:34.859508 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-97523eb5-22aa-45b6-b24d-e75bd9f742e1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:34.865820 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-97523eb5-22aa-45b6-b24d-e75bd9f742e1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:34.866364 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-97523eb5-22aa-45b6-b24d-e75bd9f742e1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:34.866765 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-97523eb5-22aa-45b6-b24d-e75bd9f742e1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:34.867465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-97523eb5-22aa-45b6-b24d-e75bd9f742e1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:34.867917 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-97523eb5-22aa-45b6-b24d-e75bd9f742e1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:34.868336 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-97523eb5-22aa-45b6-b24d-e75bd9f742e1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:34.905795 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-97523eb5-22aa-45b6-b24d-e75bd9f742e1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:34.906314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-97523eb5-22aa-45b6-b24d-e75bd9f742e1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:34.906753 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-97523eb5-22aa-45b6-b24d-e75bd9f742e1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:34.907204 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-97523eb5-22aa-45b6-b24d-e75bd9f742e1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lazy-loading 'fault' on Instance uuid 686e0b3f-da08-4b12-b376-c7f3f88474b8 {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:34.953466 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-97523eb5-22aa-45b6-b24d-e75bd9f742e1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:34.955624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-97523eb5-22aa-45b6-b24d-e75bd9f742e1 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 200 len: 1312 microversion: 2.1 time: 0.101341 Aug 24 11:33:34.956205 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 410/833] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:34 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:35.977645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3b41c6d5-80b2-441a-9ca7-93545ce20f3e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:35.978299 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3b41c6d5-80b2-441a-9ca7-93545ce20f3e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: 686e0b3f-da08-4b12-b376-c7f3f88474b8] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:35.985060 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3b41c6d5-80b2-441a-9ca7-93545ce20f3e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:35.985544 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3b41c6d5-80b2-441a-9ca7-93545ce20f3e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:35.986024 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3b41c6d5-80b2-441a-9ca7-93545ce20f3e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:35.986716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3b41c6d5-80b2-441a-9ca7-93545ce20f3e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:35.987175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3b41c6d5-80b2-441a-9ca7-93545ce20f3e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:35.987602 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3b41c6d5-80b2-441a-9ca7-93545ce20f3e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:36.001711 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-3b41c6d5-80b2-441a-9ca7-93545ce20f3e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] HTTP exception thrown: Instance 686e0b3f-da08-4b12-b376-c7f3f88474b8 could not be found. Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3b41c6d5-80b2-441a-9ca7-93545ce20f3e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Request method failure captured: Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 HTTP/1.1 Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgsA8Jn_BUXkOSSf-IXqjq3ClFLYqNACLutdEq5Ij1NsviZ-h751UGnirP3f1ukDzGHkrgVXnxtFPib47w8CdDod3TnqCh2kVL57Xs2-fzXXISHIUuF_FZW58616j9CbFCbND1btJXqiSIS_4nJdx7k-0ePa33Pu5vyClvgN35VuW6o Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: e2a13f3ca60643a9a3507476325d351a Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:33:36.003309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:33:36.004966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e2a13f3ca60643a9a3507476325d351a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:33:36.004966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:33:36.004966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: e2a13f3ca60643a9a3507476325d351a Aug 24 11:33:36.004966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:33:36.004966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-ServerRescueNegativeTestJSON-1136194767-project Aug 24 11:33:36.004966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:33:36.004966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:33:36.004966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 57be68e76fc14d2ca309571e284509bd Aug 24 11:33:36.004966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1136194767-project Aug 24 11:33:36.004966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:33:36.004966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 686e0b3f-da08-4b12-b376-c7f3f88474b8 could not be found. Aug 24 11:33:36.004966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '686e0b3f-da08-4b12-b376-c7f3f88474b8'} Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 686e0b3f-da08-4b12-b376-c7f3f88474b8 could not be found. Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:36.005749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 686e0b3f-da08-4b12-b376-c7f3f88474b8 could not be found. Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 686e0b3f-da08-4b12-b376-c7f3f88474b8 could not be found. Aug 24 11:33:36.007229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:36.008554 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3b41c6d5-80b2-441a-9ca7-93545ce20f3e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Returning 404 to user: Instance 686e0b3f-da08-4b12-b376-c7f3f88474b8 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:36.008554 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3b41c6d5-80b2-441a-9ca7-93545ce20f3e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8" status: 404 len: 111 microversion: 2.1 time: 0.031872 Aug 24 11:33:36.008554 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 424/834] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:35 2022] GET /compute/v2.1/servers/686e0b3f-da08-4b12-b376-c7f3f88474b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:36.013746 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2b6f545d-89d1-42dd-88a8-7c8c85fc6697 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:36.014278 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-2b6f545d-89d1-42dd-88a8-7c8c85fc6697 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:36.021048 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2b6f545d-89d1-42dd-88a8-7c8c85fc6697 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:36.021522 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2b6f545d-89d1-42dd-88a8-7c8c85fc6697 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:36.021995 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2b6f545d-89d1-42dd-88a8-7c8c85fc6697 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:36.022687 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2b6f545d-89d1-42dd-88a8-7c8c85fc6697 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:36.023148 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2b6f545d-89d1-42dd-88a8-7c8c85fc6697 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:36.023571 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2b6f545d-89d1-42dd-88a8-7c8c85fc6697 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:36.054688 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-2b6f545d-89d1-42dd-88a8-7c8c85fc6697 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Going to try to terminate instance {{(pid=121222) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:33:36.069657 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:36.429142 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-2b6f545d-89d1-42dd-88a8-7c8c85fc6697 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 204 len: 0 microversion: 2.1 time: 0.419362 Aug 24 11:33:36.429754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 411/835] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:33:36 2022] DELETE /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:36.438641 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-071b58bc-2f47-4397-ae70-56c6221aa9a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:36.439268 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-071b58bc-2f47-4397-ae70-56c6221aa9a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:36.445847 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-071b58bc-2f47-4397-ae70-56c6221aa9a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:36.446376 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-071b58bc-2f47-4397-ae70-56c6221aa9a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:36.446814 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-071b58bc-2f47-4397-ae70-56c6221aa9a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:36.447539 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-071b58bc-2f47-4397-ae70-56c6221aa9a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:36.448013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-071b58bc-2f47-4397-ae70-56c6221aa9a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:36.448436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-071b58bc-2f47-4397-ae70-56c6221aa9a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:36.581639 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-071b58bc-2f47-4397-ae70-56c6221aa9a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:36.589738 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-071b58bc-2f47-4397-ae70-56c6221aa9a6 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.155208 Aug 24 11:33:36.590331 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 425/836] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:36 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:36.802247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-76b5fdbc-cc2a-49b2-8074-614b3b0e2345 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1147142482"}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:36.802861 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-76b5fdbc-cc2a-49b2-8074-614b3b0e2345 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:36.809582 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-76b5fdbc-cc2a-49b2-8074-614b3b0e2345 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:36.810126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-76b5fdbc-cc2a-49b2-8074-614b3b0e2345 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:36.810567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-76b5fdbc-cc2a-49b2-8074-614b3b0e2345 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:36.811262 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-76b5fdbc-cc2a-49b2-8074-614b3b0e2345 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:36.811720 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-76b5fdbc-cc2a-49b2-8074-614b3b0e2345 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:36.812145 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-76b5fdbc-cc2a-49b2-8074-614b3b0e2345 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:36.942560 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.network.security_group_api [None req-76b5fdbc-cc2a-49b2-8074-614b3b0e2345 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Removing security group 56192c3c-363c-444b-848e-5493ec688ebd from port 7abd8996-69bf-4018-bb9e-c017b40dc1cd Aug 24 11:33:37.324844 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-76b5fdbc-cc2a-49b2-8074-614b3b0e2345 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "POST /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/action" status: 202 len: 0 microversion: 2.1 time: 0.526857 Aug 24 11:33:37.330486 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 412/837] 10.222.0.83 () {60 vars in 1278 bytes} [Wed Aug 24 11:33:36 2022] POST /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:33:37.334387 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-d4b78f9f-a76e-42cf-9276-d1bee40cd2ab req-4db1684c-874a-46aa-a581-bd43c979a160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f09e8c6-56b6-426a-8e2c-9d7a35fb1841", "tag": "7abd8996-69bf-4018-bb9e-c017b40dc1cd"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:37.344862 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-d4b78f9f-a76e-42cf-9276-d1bee40cd2ab req-4db1684c-874a-46aa-a581-bd43c979a160 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:37.345347 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-d4b78f9f-a76e-42cf-9276-d1bee40cd2ab req-4db1684c-874a-46aa-a581-bd43c979a160 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:37.345776 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-d4b78f9f-a76e-42cf-9276-d1bee40cd2ab req-4db1684c-874a-46aa-a581-bd43c979a160 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:37.364992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-d4b78f9f-a76e-42cf-9276-d1bee40cd2ab req-4db1684c-874a-46aa-a581-bd43c979a160 service nova] Creating event network-changed:7abd8996-69bf-4018-bb9e-c017b40dc1cd for instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 on hv-cinder-85427 Aug 24 11:33:37.370119 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-d4b78f9f-a76e-42cf-9276-d1bee40cd2ab req-4db1684c-874a-46aa-a581-bd43c979a160 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039853 Aug 24 11:33:37.370818 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 426/838] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:37.612703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c087e6ac-9aa0-45d8-9cf7-f7d4aec07e64 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:37.613416 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c087e6ac-9aa0-45d8-9cf7-f7d4aec07e64 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:37.622185 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c087e6ac-9aa0-45d8-9cf7-f7d4aec07e64 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:37.623091 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c087e6ac-9aa0-45d8-9cf7-f7d4aec07e64 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:37.623533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c087e6ac-9aa0-45d8-9cf7-f7d4aec07e64 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:37.624495 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c087e6ac-9aa0-45d8-9cf7-f7d4aec07e64 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:37.625171 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c087e6ac-9aa0-45d8-9cf7-f7d4aec07e64 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:37.625695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c087e6ac-9aa0-45d8-9cf7-f7d4aec07e64 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:37.828232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c087e6ac-9aa0-45d8-9cf7-f7d4aec07e64 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:37.836149 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c087e6ac-9aa0-45d8-9cf7-f7d4aec07e64 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.229158 Aug 24 11:33:37.836807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 413/839] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:37 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:38.602492 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-85506e81-561a-4f7c-b811-03fb4b361b6a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:38.603071 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-85506e81-561a-4f7c-b811-03fb4b361b6a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:38.610132 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85506e81-561a-4f7c-b811-03fb4b361b6a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:38.610686 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85506e81-561a-4f7c-b811-03fb4b361b6a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:38.611309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85506e81-561a-4f7c-b811-03fb4b361b6a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:38.612076 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85506e81-561a-4f7c-b811-03fb4b361b6a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:38.612622 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85506e81-561a-4f7c-b811-03fb4b361b6a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:38.613100 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85506e81-561a-4f7c-b811-03fb4b361b6a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:38.740560 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-85506e81-561a-4f7c-b811-03fb4b361b6a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lazy-loading 'services' on Instance uuid 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:38.856713 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-355d8aa0-e80a-4fd9-b987-4b4cf7d63e00 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:38.857418 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-355d8aa0-e80a-4fd9-b987-4b4cf7d63e00 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:38.864805 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-355d8aa0-e80a-4fd9-b987-4b4cf7d63e00 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:38.865284 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-355d8aa0-e80a-4fd9-b987-4b4cf7d63e00 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:38.865978 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-355d8aa0-e80a-4fd9-b987-4b4cf7d63e00 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:38.866989 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-355d8aa0-e80a-4fd9-b987-4b4cf7d63e00 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:38.867624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-355d8aa0-e80a-4fd9-b987-4b4cf7d63e00 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:38.868117 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-355d8aa0-e80a-4fd9-b987-4b4cf7d63e00 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:39.005349 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-85506e81-561a-4f7c-b811-03fb4b361b6a tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/os-volume_attachments/14169c81-ad70-41d8-8ca2-3a1df810e38e" status: 202 len: 0 microversion: 2.1 time: 0.407257 Aug 24 11:33:39.006776 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 427/840] 10.222.0.83 () {58 vars in 1416 bytes} [Wed Aug 24 11:33:38 2022] DELETE /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/os-volume_attachments/14169c81-ad70-41d8-8ca2-3a1df810e38e => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:33:39.018106 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-05aa9671-1606-4ef7-9283-6f05528aabe0 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:39.019271 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-355d8aa0-e80a-4fd9-b987-4b4cf7d63e00 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:39.022041 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-05aa9671-1606-4ef7-9283-6f05528aabe0 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:39.029134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05aa9671-1606-4ef7-9283-6f05528aabe0 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:39.029662 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-355d8aa0-e80a-4fd9-b987-4b4cf7d63e00 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.176435 Aug 24 11:33:39.030026 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05aa9671-1606-4ef7-9283-6f05528aabe0 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:39.035674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05aa9671-1606-4ef7-9283-6f05528aabe0 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:39.035849 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 414/841] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:38 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:39.035959 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05aa9671-1606-4ef7-9283-6f05528aabe0 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:39.035959 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05aa9671-1606-4ef7-9283-6f05528aabe0 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:39.035959 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05aa9671-1606-4ef7-9283-6f05528aabe0 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:39.064377 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-05aa9671-1606-4ef7-9283-6f05528aabe0 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053534 Aug 24 11:33:39.064964 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 428/842] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:39 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:33:39.385467 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-9fc06bc9-2096-4bc0-bb71-88d09a971ada req-26be0654-c5eb-4290-93d2-2d8347a29641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f09e8c6-56b6-426a-8e2c-9d7a35fb1841", "tag": "7abd8996-69bf-4018-bb9e-c017b40dc1cd"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:39.395443 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-9fc06bc9-2096-4bc0-bb71-88d09a971ada req-26be0654-c5eb-4290-93d2-2d8347a29641 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:39.395915 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-9fc06bc9-2096-4bc0-bb71-88d09a971ada req-26be0654-c5eb-4290-93d2-2d8347a29641 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:39.396340 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-9fc06bc9-2096-4bc0-bb71-88d09a971ada req-26be0654-c5eb-4290-93d2-2d8347a29641 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:39.407994 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-9fc06bc9-2096-4bc0-bb71-88d09a971ada req-26be0654-c5eb-4290-93d2-2d8347a29641 service nova] Creating event network-changed:7abd8996-69bf-4018-bb9e-c017b40dc1cd for instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 on hv-cinder-85427 Aug 24 11:33:39.412783 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-9fc06bc9-2096-4bc0-bb71-88d09a971ada req-26be0654-c5eb-4290-93d2-2d8347a29641 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031120 Aug 24 11:33:39.416195 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 415/843] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:40.054489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-925b9a84-706a-4010-9814-8f2c6dcb5752 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:40.056635 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-925b9a84-706a-4010-9814-8f2c6dcb5752 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:40.062184 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-925b9a84-706a-4010-9814-8f2c6dcb5752 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:40.062681 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-925b9a84-706a-4010-9814-8f2c6dcb5752 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:40.063125 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-925b9a84-706a-4010-9814-8f2c6dcb5752 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:40.063824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-925b9a84-706a-4010-9814-8f2c6dcb5752 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:40.064283 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-925b9a84-706a-4010-9814-8f2c6dcb5752 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:40.064709 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-925b9a84-706a-4010-9814-8f2c6dcb5752 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:40.079189 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7deef8c8-8b1a-4871-9e62-ad83889c6766 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:40.081687 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7deef8c8-8b1a-4871-9e62-ad83889c6766 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:40.090053 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7deef8c8-8b1a-4871-9e62-ad83889c6766 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:40.090781 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7deef8c8-8b1a-4871-9e62-ad83889c6766 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:40.091290 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7deef8c8-8b1a-4871-9e62-ad83889c6766 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:40.092072 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7deef8c8-8b1a-4871-9e62-ad83889c6766 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:40.092626 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7deef8c8-8b1a-4871-9e62-ad83889c6766 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:40.093074 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7deef8c8-8b1a-4871-9e62-ad83889c6766 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:40.126464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7deef8c8-8b1a-4871-9e62-ad83889c6766 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052538 Aug 24 11:33:40.127138 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 416/844] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:40 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:40.262345 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-925b9a84-706a-4010-9814-8f2c6dcb5752 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:40.271732 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-925b9a84-706a-4010-9814-8f2c6dcb5752 tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1520 microversion: 2.1 time: 0.221209 Aug 24 11:33:40.272325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 429/845] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:40 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:40.443695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-107d4e4c-e4ca-4c1b-b97e-9031a2a25891 req-966beffd-0bdf-4ba9-bdfa-aef6ec3ca38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939", "name": "network-vif-deleted", "tag": "30d8bd12-3adf-4f5f-a775-86e909be5297"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:40.455296 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-107d4e4c-e4ca-4c1b-b97e-9031a2a25891 req-966beffd-0bdf-4ba9-bdfa-aef6ec3ca38c service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:40.455703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-107d4e4c-e4ca-4c1b-b97e-9031a2a25891 req-966beffd-0bdf-4ba9-bdfa-aef6ec3ca38c service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:40.456129 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-107d4e4c-e4ca-4c1b-b97e-9031a2a25891 req-966beffd-0bdf-4ba9-bdfa-aef6ec3ca38c service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:40.468448 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-107d4e4c-e4ca-4c1b-b97e-9031a2a25891 req-966beffd-0bdf-4ba9-bdfa-aef6ec3ca38c service nova] Creating event network-vif-deleted:30d8bd12-3adf-4f5f-a775-86e909be5297 for instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 on hv-cinder-85427 Aug 24 11:33:40.474000 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-107d4e4c-e4ca-4c1b-b97e-9031a2a25891 req-966beffd-0bdf-4ba9-bdfa-aef6ec3ca38c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034372 Aug 24 11:33:40.478665 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 417/846] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:41.139408 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-97894236-42f0-48fe-9577-23af1c0641df tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:41.141568 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-97894236-42f0-48fe-9577-23af1c0641df tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:41.148228 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97894236-42f0-48fe-9577-23af1c0641df tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:41.148706 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97894236-42f0-48fe-9577-23af1c0641df tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:41.149142 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97894236-42f0-48fe-9577-23af1c0641df tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:41.149823 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97894236-42f0-48fe-9577-23af1c0641df tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:41.150361 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97894236-42f0-48fe-9577-23af1c0641df tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:41.150711 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97894236-42f0-48fe-9577-23af1c0641df tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:41.180901 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-97894236-42f0-48fe-9577-23af1c0641df tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045959 Aug 24 11:33:41.181462 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 430/847] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:33:41 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:33:41.192711 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-89f97934-0a7f-4612-9fcc-2b47fb12d28e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:41.193294 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-89f97934-0a7f-4612-9fcc-2b47fb12d28e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:41.201092 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89f97934-0a7f-4612-9fcc-2b47fb12d28e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:41.201584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89f97934-0a7f-4612-9fcc-2b47fb12d28e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:41.202064 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89f97934-0a7f-4612-9fcc-2b47fb12d28e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:41.202759 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89f97934-0a7f-4612-9fcc-2b47fb12d28e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:41.203208 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89f97934-0a7f-4612-9fcc-2b47fb12d28e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:41.203629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89f97934-0a7f-4612-9fcc-2b47fb12d28e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:41.282816 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-89f97934-0a7f-4612-9fcc-2b47fb12d28e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] HTTP exception thrown: Instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 is not attached to volume 14169c81-ad70-41d8-8ca2-3a1df810e38e Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-89f97934-0a7f-4612-9fcc-2b47fb12d28e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Request method failure captured: Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: DELETE /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/os-volume_attachments/14169c81-ad70-41d8-8ca2-3a1df810e38e HTTP/1.1 Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBguHBQtz_2TmDswDOBHI4x8HeQO4i0s6o6npGy96sb0X_INvEFHA4UMdZJ7rE_R3fYMO3__mQtuwMhiSn_qeLEhPoTJCuvlJjIKPIp1pbpnGSAmTIiC6aYyr6EMVFLoAt1oTmnl1Ltb9jphahNyl-vxVOBtJR368as6B3YAMUTQSPKA Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 7e02d1127ce24c20822ab10c78edb00b Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-TestMinimumBasicScenario-605629990 Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:33:41.285624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:33:41.289094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7e02d1127ce24c20822ab10c78edb00b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7e02d1127ce24c20822ab10c78edb00b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7e02d1127ce24c20822ab10c78edb00b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7e02d1127ce24c20822ab10c78edb00b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:33:41.289094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-TestMinimumBasicScenario-605629990 Aug 24 11:33:41.289094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 7e02d1127ce24c20822ab10c78edb00b Aug 24 11:33:41.289094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-TestMinimumBasicScenario-605629990 Aug 24 11:33:41.289094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-TestMinimumBasicScenario-605629990-project Aug 24 11:33:41.289094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:33:41.289094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:33:41.289094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 413dcd64b46f4e10947d9347dff434cc Aug 24 11:33:41.289094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-TestMinimumBasicScenario-605629990-project Aug 24 11:33:41.289094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:33:41.289094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 is not attached to volume 14169c81-ad70-41d8-8ca2-3a1df810e38e Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'server_id': '6f09e8c6-56b6-426a-8e2c-9d7a35fb1841', 'id': '14169c81-ad70-41d8-8ca2-3a1df810e38e'} Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 14169c81-ad70-41d8-8ca2-3a1df810e38e. Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:41.289834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 is not attached to volume 14169c81-ad70-41d8-8ca2-3a1df810e38e Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 is not attached to volume 14169c81-ad70-41d8-8ca2-3a1df810e38e Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:33:41.291234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-89f97934-0a7f-4612-9fcc-2b47fb12d28e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Returning 404 to user: Instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 is not attached to volume 14169c81-ad70-41d8-8ca2-3a1df810e38e {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:41.292398 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-89f97934-0a7f-4612-9fcc-2b47fb12d28e tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/os-volume_attachments/14169c81-ad70-41d8-8ca2-3a1df810e38e" status: 404 len: 154 microversion: 2.1 time: 0.099009 Aug 24 11:33:41.292398 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 418/848] 10.222.0.83 () {58 vars in 1416 bytes} [Wed Aug 24 11:33:41 2022] DELETE /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841/os-volume_attachments/14169c81-ad70-41d8-8ca2-3a1df810e38e => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:41.296334 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cbcc462b-21a4-4ad3-acd9-6ead516b93ad tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:41.296951 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cbcc462b-21a4-4ad3-acd9-6ead516b93ad tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:41.313756 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cbcc462b-21a4-4ad3-acd9-6ead516b93ad tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:41.314329 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cbcc462b-21a4-4ad3-acd9-6ead516b93ad tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:41.314776 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cbcc462b-21a4-4ad3-acd9-6ead516b93ad tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:41.315518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cbcc462b-21a4-4ad3-acd9-6ead516b93ad tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:41.315959 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cbcc462b-21a4-4ad3-acd9-6ead516b93ad tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:41.316420 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cbcc462b-21a4-4ad3-acd9-6ead516b93ad tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:41.356674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cbcc462b-21a4-4ad3-acd9-6ead516b93ad tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:41.357156 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cbcc462b-21a4-4ad3-acd9-6ead516b93ad tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:41.357591 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cbcc462b-21a4-4ad3-acd9-6ead516b93ad tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:41.358156 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-cbcc462b-21a4-4ad3-acd9-6ead516b93ad tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lazy-loading 'fault' on Instance uuid ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:33:41.400477 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cbcc462b-21a4-4ad3-acd9-6ead516b93ad tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57be68e76fc14d2ca309571e284509bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a13f3ca60643a9a3507476325d351a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:41.410179 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cbcc462b-21a4-4ad3-acd9-6ead516b93ad tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 200 len: 1311 microversion: 2.1 time: 0.120046 Aug 24 11:33:41.410872 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 431/849] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:41 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 1311 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:33:42.431104 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4814d3ae-3ee2-48c0-b959-e6a11795d45e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:42.431756 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4814d3ae-3ee2-48c0-b959-e6a11795d45e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] [instance: ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:42.439050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4814d3ae-3ee2-48c0-b959-e6a11795d45e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:42.439528 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4814d3ae-3ee2-48c0-b959-e6a11795d45e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:42.439955 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4814d3ae-3ee2-48c0-b959-e6a11795d45e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:42.440638 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4814d3ae-3ee2-48c0-b959-e6a11795d45e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:42.441083 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4814d3ae-3ee2-48c0-b959-e6a11795d45e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:42.441498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4814d3ae-3ee2-48c0-b959-e6a11795d45e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:42.455381 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-4814d3ae-3ee2-48c0-b959-e6a11795d45e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] HTTP exception thrown: Instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 could not be found. Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4814d3ae-3ee2-48c0-b959-e6a11795d45e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Request method failure captured: Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 HTTP/1.1 Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgsA8Jn_BUXkOSSf-IXqjq3ClFLYqNACLutdEq5Ij1NsviZ-h751UGnirP3f1ukDzGHkrgVXnxtFPib47w8CdDod3TnqCh2kVL57Xs2-fzXXISHIUuF_FZW58616j9CbFCbND1btJXqiSIS_4nJdx7k-0ePa33Pu5vyClvgN35VuW6o Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: e2a13f3ca60643a9a3507476325d351a Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:33:42.456919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:33:42.458718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e2a13f3ca60643a9a3507476325d351a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e2a13f3ca60643a9a3507476325d351a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:33:42.458718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:33:42.458718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: e2a13f3ca60643a9a3507476325d351a Aug 24 11:33:42.458718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1136194767 Aug 24 11:33:42.458718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-ServerRescueNegativeTestJSON-1136194767-project Aug 24 11:33:42.458718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:33:42.458718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:33:42.458718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 57be68e76fc14d2ca309571e284509bd Aug 24 11:33:42.458718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1136194767-project Aug 24 11:33:42.458718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:33:42.458718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 could not be found. Aug 24 11:33:42.458718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': 'ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939'} Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 could not be found. Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:42.459772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 could not be found. Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 could not be found. Aug 24 11:33:42.461247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:33:42.462892 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4814d3ae-3ee2-48c0-b959-e6a11795d45e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] Returning 404 to user: Instance ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:42.462892 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4814d3ae-3ee2-48c0-b959-e6a11795d45e tempest-ServerRescueNegativeTestJSON-1136194767 tempest-ServerRescueNegativeTestJSON-1136194767-project] 10.222.0.83 "GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939" status: 404 len: 111 microversion: 2.1 time: 0.031138 Aug 24 11:33:42.462892 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 419/850] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:42 2022] GET /compute/v2.1/servers/ea3460ea-ca7c-4d4b-bbb9-aebd4ab24939 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:42.610515 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fc69a39b-9280-4d24-8d3a-b59612428e4c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:42.611073 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fc69a39b-9280-4d24-8d3a-b59612428e4c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:42.617930 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc69a39b-9280-4d24-8d3a-b59612428e4c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:42.618422 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc69a39b-9280-4d24-8d3a-b59612428e4c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:42.618853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc69a39b-9280-4d24-8d3a-b59612428e4c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:42.619549 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc69a39b-9280-4d24-8d3a-b59612428e4c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:42.620015 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc69a39b-9280-4d24-8d3a-b59612428e4c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:42.620411 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc69a39b-9280-4d24-8d3a-b59612428e4c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:42.646343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fc69a39b-9280-4d24-8d3a-b59612428e4c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:33:42.904266 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fc69a39b-9280-4d24-8d3a-b59612428e4c tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 204 len: 0 microversion: 2.1 time: 0.297275 Aug 24 11:33:42.905226 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 432/851] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:33:42 2022] DELETE /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:33:42.913569 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-538e7a13-aaf8-4776-a475-39a245fe7f37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:42.914218 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-538e7a13-aaf8-4776-a475-39a245fe7f37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:42.920237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-538e7a13-aaf8-4776-a475-39a245fe7f37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:42.920722 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-538e7a13-aaf8-4776-a475-39a245fe7f37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:42.921158 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-538e7a13-aaf8-4776-a475-39a245fe7f37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:42.921843 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-538e7a13-aaf8-4776-a475-39a245fe7f37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:42.922319 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-538e7a13-aaf8-4776-a475-39a245fe7f37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:42.922740 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-538e7a13-aaf8-4776-a475-39a245fe7f37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:43.163107 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-538e7a13-aaf8-4776-a475-39a245fe7f37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:43.171199 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-538e7a13-aaf8-4776-a475-39a245fe7f37 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1553 microversion: 2.1 time: 0.261601 Aug 24 11:33:43.171894 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 420/852] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:42 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:44.193726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e5d28882-5a31-453d-aa24-1b8fdea4b359 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:44.195267 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e5d28882-5a31-453d-aa24-1b8fdea4b359 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:44.202963 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5d28882-5a31-453d-aa24-1b8fdea4b359 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:44.203458 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5d28882-5a31-453d-aa24-1b8fdea4b359 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:44.203908 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5d28882-5a31-453d-aa24-1b8fdea4b359 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:44.204602 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5d28882-5a31-453d-aa24-1b8fdea4b359 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:44.205051 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5d28882-5a31-453d-aa24-1b8fdea4b359 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:44.205471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5d28882-5a31-453d-aa24-1b8fdea4b359 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:44.361126 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e5d28882-5a31-453d-aa24-1b8fdea4b359 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:44.369417 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e5d28882-5a31-453d-aa24-1b8fdea4b359 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1553 microversion: 2.1 time: 0.180153 Aug 24 11:33:44.370027 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 433/853] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:44 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:45.393658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6ae9fe74-6e3c-40e4-a57b-af7d6c9816be tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:45.394557 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6ae9fe74-6e3c-40e4-a57b-af7d6c9816be tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:45.403173 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6ae9fe74-6e3c-40e4-a57b-af7d6c9816be tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:45.403740 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6ae9fe74-6e3c-40e4-a57b-af7d6c9816be tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:45.404183 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6ae9fe74-6e3c-40e4-a57b-af7d6c9816be tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:45.404910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6ae9fe74-6e3c-40e4-a57b-af7d6c9816be tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:45.405364 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6ae9fe74-6e3c-40e4-a57b-af7d6c9816be tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:45.406194 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6ae9fe74-6e3c-40e4-a57b-af7d6c9816be tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:45.575555 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6ae9fe74-6e3c-40e4-a57b-af7d6c9816be tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:45.583714 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6ae9fe74-6e3c-40e4-a57b-af7d6c9816be tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1553 microversion: 2.1 time: 0.195085 Aug 24 11:33:45.584430 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 421/854] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:45 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1553 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:46.360805 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-43951718-6627-42fc-915b-21354fea7504 req-0c95cc04-09f6-46d3-aa4a-316740d30767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f09e8c6-56b6-426a-8e2c-9d7a35fb1841", "name": "network-vif-deleted", "tag": "7abd8996-69bf-4018-bb9e-c017b40dc1cd"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:46.371220 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-43951718-6627-42fc-915b-21354fea7504 req-0c95cc04-09f6-46d3-aa4a-316740d30767 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:46.371684 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-43951718-6627-42fc-915b-21354fea7504 req-0c95cc04-09f6-46d3-aa4a-316740d30767 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:46.372111 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-43951718-6627-42fc-915b-21354fea7504 req-0c95cc04-09f6-46d3-aa4a-316740d30767 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:46.383256 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-43951718-6627-42fc-915b-21354fea7504 req-0c95cc04-09f6-46d3-aa4a-316740d30767 service nova] Creating event network-vif-deleted:7abd8996-69bf-4018-bb9e-c017b40dc1cd for instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 on hv-cinder-85427 Aug 24 11:33:46.388641 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-43951718-6627-42fc-915b-21354fea7504 req-0c95cc04-09f6-46d3-aa4a-316740d30767 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031690 Aug 24 11:33:46.389292 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 434/855] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:33:46.606568 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4d15e8e9-ec8b-4f09-9782-0a0fc37a65b3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:46.607154 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4d15e8e9-ec8b-4f09-9782-0a0fc37a65b3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:46.613671 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4d15e8e9-ec8b-4f09-9782-0a0fc37a65b3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:46.614190 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4d15e8e9-ec8b-4f09-9782-0a0fc37a65b3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:46.614628 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4d15e8e9-ec8b-4f09-9782-0a0fc37a65b3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:46.615314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4d15e8e9-ec8b-4f09-9782-0a0fc37a65b3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:46.615763 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4d15e8e9-ec8b-4f09-9782-0a0fc37a65b3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:46.616183 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4d15e8e9-ec8b-4f09-9782-0a0fc37a65b3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:46.682369 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4d15e8e9-ec8b-4f09-9782-0a0fc37a65b3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413dcd64b46f4e10947d9347dff434cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e02d1127ce24c20822ab10c78edb00b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:46.691806 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4d15e8e9-ec8b-4f09-9782-0a0fc37a65b3 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 200 len: 1342 microversion: 2.1 time: 0.089575 Aug 24 11:33:46.697210 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 422/856] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:46 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 1342 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:33:47.714070 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-60b9cceb-3916-47d2-8044-b6db88941663 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:47.714785 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-60b9cceb-3916-47d2-8044-b6db88941663 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] [instance: 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:47.721176 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60b9cceb-3916-47d2-8044-b6db88941663 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:47.721669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60b9cceb-3916-47d2-8044-b6db88941663 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:47.722138 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60b9cceb-3916-47d2-8044-b6db88941663 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:47.722838 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60b9cceb-3916-47d2-8044-b6db88941663 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:47.723298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60b9cceb-3916-47d2-8044-b6db88941663 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:47.723722 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60b9cceb-3916-47d2-8044-b6db88941663 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:47.737230 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-60b9cceb-3916-47d2-8044-b6db88941663 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] HTTP exception thrown: Instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 could not be found. Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-60b9cceb-3916-47d2-8044-b6db88941663 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Request method failure captured: Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 HTTP/1.1 Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBguHBQtz_2TmDswDOBHI4x8HeQO4i0s6o6npGy96sb0X_INvEFHA4UMdZJ7rE_R3fYMO3__mQtuwMhiSn_qeLEhPoTJCuvlJjIKPIp1pbpnGSAmTIiC6aYyr6EMVFLoAt1oTmnl1Ltb9jphahNyl-vxVOBtJR368as6B3YAMUTQSPKA Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 7e02d1127ce24c20822ab10c78edb00b Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-TestMinimumBasicScenario-605629990 Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:33:47.738977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:33:47.740437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7e02d1127ce24c20822ab10c78edb00b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7e02d1127ce24c20822ab10c78edb00b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7e02d1127ce24c20822ab10c78edb00b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7e02d1127ce24c20822ab10c78edb00b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:33:47.740437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-TestMinimumBasicScenario-605629990 Aug 24 11:33:47.740437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 7e02d1127ce24c20822ab10c78edb00b Aug 24 11:33:47.740437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-TestMinimumBasicScenario-605629990 Aug 24 11:33:47.740437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-TestMinimumBasicScenario-605629990-project Aug 24 11:33:47.740437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:33:47.740437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:33:47.740437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 413dcd64b46f4e10947d9347dff434cc Aug 24 11:33:47.740437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-TestMinimumBasicScenario-605629990-project Aug 24 11:33:47.740437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:33:47.740437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 could not be found. Aug 24 11:33:47.740437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '6f09e8c6-56b6-426a-8e2c-9d7a35fb1841'} Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 could not be found. Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:33:47.741229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 could not be found. Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 could not be found. Aug 24 11:33:47.742936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:33:47.743990 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-60b9cceb-3916-47d2-8044-b6db88941663 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Returning 404 to user: Instance 6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:33:47.743990 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-60b9cceb-3916-47d2-8044-b6db88941663 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841" status: 404 len: 111 microversion: 2.1 time: 0.031284 Aug 24 11:33:47.743990 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 435/857] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:33:47 2022] GET /compute/v2.1/servers/6f09e8c6-56b6-426a-8e2c-9d7a35fb1841 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:33:47.749685 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-389db49f-c22c-4a7d-ad45-8f16a9f75b35 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] Calling method '.version_select at 0x7f723cdcc160>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:47.864361 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-389db49f-c22c-4a7d-ad45-8f16a9f75b35 tempest-TestMinimumBasicScenario-605629990 tempest-TestMinimumBasicScenario-605629990-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1384024659" status: 202 len: 0 microversion: 2.1 time: 0.118129 Aug 24 11:33:47.864955 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 423/858] 10.222.0.83 () {58 vars in 1272 bytes} [Wed Aug 24 11:33:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1384024659 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:33:55.622146 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-876f3ae4-4df9-45d9-bbb2-dff3be427b76 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Action: 'create', calling method: .version_select at 0x7f72420c13a0>, body: {"keypair": {"name": "tempest-keypair-740773957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs552A6f0SnaLADPK9ZCLW2+Yp7rzJNWmnpKQv9dX+iprF0X3NVW6PM2qigzF9y062oFB53aUeB9llybpgesgVBJl5cLF3qggR6z/UOHTHXnK7Lj1KPMWtn36xCpEP/GQ=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:55.647479 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-876f3ae4-4df9-45d9-bbb2-dff3be427b76 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Getting quotas for project de6ccf52d6394c01859a5ccf0774f2d8. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:33:55.652341 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-876f3ae4-4df9-45d9-bbb2-dff3be427b76 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Getting quotas for user 4dfbe3078d714129b5a6e6e45dbc0b25 and project de6ccf52d6394c01859a5ccf0774f2d8. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:33:55.732740 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-876f3ae4-4df9-45d9-bbb2-dff3be427b76 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.267713 Aug 24 11:33:55.733354 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 436/859] 10.222.0.83 () {62 vars in 1200 bytes} [Wed Aug 24 11:33:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 270 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 11:33:58.801326 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1948014128", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e286999e-3204-444c-b76a-73c5933f8ba9"}], "security_groups": [{"name": "tempest-securitygroup--1591987928"}], "key_name": "tempest-keypair-740773957", "user_data": "}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:33:58.818561 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:58.819429 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:58.925233 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] validate_networks() for [('e286999e-3204-444c-b76a-73c5933f8ba9', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:33:59.308424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:33:59.308910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:33:59.309389 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:33:59.309801 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:33:59.310237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:33:59.319460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:59.319873 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:59.320318 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:59.321050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:33:59.321682 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:33:59.322266 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:33:59.339778 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Getting quotas for project de6ccf52d6394c01859a5ccf0774f2d8. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:33:59.344042 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Getting quotas for user 4dfbe3078d714129b5a6e6e45dbc0b25 and project de6ccf52d6394c01859a5ccf0774f2d8. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:33:59.357255 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:33:59.359938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:33:59.473337 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-89b86e03-f195-4969-a7da-150536649432 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.676718 Aug 24 11:33:59.478514 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 424/860] 10.222.0.83 () {62 vars in 1188 bytes} [Wed Aug 24 11:33:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 11:33:59.489662 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0ee3b2d3-b05a-45d5-88a0-ca5fc9aeb110 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:33:59.490623 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0ee3b2d3-b05a-45d5-88a0-ca5fc9aeb110 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:33:59.492288 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:33:59.578025 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0ee3b2d3-b05a-45d5-88a0-ca5fc9aeb110 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:59.590049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0ee3b2d3-b05a-45d5-88a0-ca5fc9aeb110 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:59.592533 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0ee3b2d3-b05a-45d5-88a0-ca5fc9aeb110 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:33:59.593678 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0ee3b2d3-b05a-45d5-88a0-ca5fc9aeb110 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1281 microversion: 2.20 time: 0.108084 Aug 24 11:33:59.594278 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 437/861] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:33:59 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1281 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:34:00.616988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-58e953f3-bee8-4803-83d7-4a50eb75aebc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:00.617597 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-58e953f3-bee8-4803-83d7-4a50eb75aebc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:00.624577 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58e953f3-bee8-4803-83d7-4a50eb75aebc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:00.625061 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58e953f3-bee8-4803-83d7-4a50eb75aebc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:00.625493 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58e953f3-bee8-4803-83d7-4a50eb75aebc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:00.626212 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58e953f3-bee8-4803-83d7-4a50eb75aebc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:00.626661 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58e953f3-bee8-4803-83d7-4a50eb75aebc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:00.627079 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58e953f3-bee8-4803-83d7-4a50eb75aebc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:00.689460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-58e953f3-bee8-4803-83d7-4a50eb75aebc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:00.699474 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-58e953f3-bee8-4803-83d7-4a50eb75aebc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:00.701068 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-58e953f3-bee8-4803-83d7-4a50eb75aebc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:00.702208 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-58e953f3-bee8-4803-83d7-4a50eb75aebc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1285 microversion: 2.20 time: 0.089620 Aug 24 11:34:00.704077 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 425/862] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:34:00 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:34:01.724469 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-41f3a477-4cbb-4f53-ab58-827b561144d9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:01.725692 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-41f3a477-4cbb-4f53-ab58-827b561144d9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:01.732765 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-41f3a477-4cbb-4f53-ab58-827b561144d9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:01.733254 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-41f3a477-4cbb-4f53-ab58-827b561144d9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:01.733683 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-41f3a477-4cbb-4f53-ab58-827b561144d9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:01.734429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-41f3a477-4cbb-4f53-ab58-827b561144d9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:01.734879 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-41f3a477-4cbb-4f53-ab58-827b561144d9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:01.735292 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-41f3a477-4cbb-4f53-ab58-827b561144d9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:01.797667 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-41f3a477-4cbb-4f53-ab58-827b561144d9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:01.806031 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-41f3a477-4cbb-4f53-ab58-827b561144d9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:01.808029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-41f3a477-4cbb-4f53-ab58-827b561144d9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:01.809180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-41f3a477-4cbb-4f53-ab58-827b561144d9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1333 microversion: 2.20 time: 0.088775 Aug 24 11:34:01.809734 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 438/863] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:34:01 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:34:02.832317 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c640e3b3-6fdb-4a3f-9c1d-021bd442aebb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:02.832967 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c640e3b3-6fdb-4a3f-9c1d-021bd442aebb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:02.840446 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c640e3b3-6fdb-4a3f-9c1d-021bd442aebb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:02.841140 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c640e3b3-6fdb-4a3f-9c1d-021bd442aebb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:02.841578 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c640e3b3-6fdb-4a3f-9c1d-021bd442aebb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:02.842346 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c640e3b3-6fdb-4a3f-9c1d-021bd442aebb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:02.842864 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c640e3b3-6fdb-4a3f-9c1d-021bd442aebb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:02.843287 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c640e3b3-6fdb-4a3f-9c1d-021bd442aebb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:03.089083 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c640e3b3-6fdb-4a3f-9c1d-021bd442aebb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:03.097616 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c640e3b3-6fdb-4a3f-9c1d-021bd442aebb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:03.099151 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c640e3b3-6fdb-4a3f-9c1d-021bd442aebb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:03.100263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c640e3b3-6fdb-4a3f-9c1d-021bd442aebb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1407 microversion: 2.20 time: 0.271950 Aug 24 11:34:03.100835 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 426/864] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:34:02 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:34:03.697852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-a11c2e5c-97e1-4b7a-9703-72d8013b1dfe req-f20beb4c-02ba-4364-bf4c-edfff01c01a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17c6a206-49d7-44b6-a24f-f5961f099597", "tag": "dfa0d250-97f7-4d9a-9f1c-edee2d559865"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:03.704109 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:03.709453 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-a11c2e5c-97e1-4b7a-9703-72d8013b1dfe req-f20beb4c-02ba-4364-bf4c-edfff01c01a4 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:03.709952 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-a11c2e5c-97e1-4b7a-9703-72d8013b1dfe req-f20beb4c-02ba-4364-bf4c-edfff01c01a4 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:03.710378 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-a11c2e5c-97e1-4b7a-9703-72d8013b1dfe req-f20beb4c-02ba-4364-bf4c-edfff01c01a4 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:03.722258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-a11c2e5c-97e1-4b7a-9703-72d8013b1dfe req-f20beb4c-02ba-4364-bf4c-edfff01c01a4 service nova] Creating event network-changed:dfa0d250-97f7-4d9a-9f1c-edee2d559865 for instance 17c6a206-49d7-44b6-a24f-f5961f099597 on hv-cinder-85427 Aug 24 11:34:03.727393 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-a11c2e5c-97e1-4b7a-9703-72d8013b1dfe req-f20beb4c-02ba-4364-bf4c-edfff01c01a4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033061 Aug 24 11:34:03.728005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 439/865] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:04.124578 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9f8b5699-415a-46b3-820e-96ca2e3d1ea9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:04.125193 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9f8b5699-415a-46b3-820e-96ca2e3d1ea9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:04.131650 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9f8b5699-415a-46b3-820e-96ca2e3d1ea9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:04.132146 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9f8b5699-415a-46b3-820e-96ca2e3d1ea9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:04.132584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9f8b5699-415a-46b3-820e-96ca2e3d1ea9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:04.133279 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9f8b5699-415a-46b3-820e-96ca2e3d1ea9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:04.133737 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9f8b5699-415a-46b3-820e-96ca2e3d1ea9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:04.134187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9f8b5699-415a-46b3-820e-96ca2e3d1ea9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:04.342559 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9f8b5699-415a-46b3-820e-96ca2e3d1ea9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:04.351313 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9f8b5699-415a-46b3-820e-96ca2e3d1ea9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:04.352838 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9f8b5699-415a-46b3-820e-96ca2e3d1ea9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:04.354556 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9f8b5699-415a-46b3-820e-96ca2e3d1ea9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1407 microversion: 2.20 time: 0.233968 Aug 24 11:34:04.355119 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 427/866] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:34:04 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:34:05.377444 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-58b4df50-52cc-4dd5-911f-cd572837f1f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:05.378163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-58b4df50-52cc-4dd5-911f-cd572837f1f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:05.384704 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-58b4df50-52cc-4dd5-911f-cd572837f1f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:05.385195 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-58b4df50-52cc-4dd5-911f-cd572837f1f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:05.385611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-58b4df50-52cc-4dd5-911f-cd572837f1f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:05.386327 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-58b4df50-52cc-4dd5-911f-cd572837f1f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:05.386774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-58b4df50-52cc-4dd5-911f-cd572837f1f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:05.387188 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-58b4df50-52cc-4dd5-911f-cd572837f1f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:05.521156 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-58b4df50-52cc-4dd5-911f-cd572837f1f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:05.529799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-58b4df50-52cc-4dd5-911f-cd572837f1f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:05.531314 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-58b4df50-52cc-4dd5-911f-cd572837f1f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:05.532408 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-58b4df50-52cc-4dd5-911f-cd572837f1f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1407 microversion: 2.20 time: 0.159732 Aug 24 11:34:05.532970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 440/867] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:34:05 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:34:06.554758 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7b5c5640-85ab-446b-9e15-cf4b1afa703d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:06.555375 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7b5c5640-85ab-446b-9e15-cf4b1afa703d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:06.561959 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b5c5640-85ab-446b-9e15-cf4b1afa703d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:06.562446 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b5c5640-85ab-446b-9e15-cf4b1afa703d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:06.562889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b5c5640-85ab-446b-9e15-cf4b1afa703d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:06.563577 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b5c5640-85ab-446b-9e15-cf4b1afa703d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:06.564027 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b5c5640-85ab-446b-9e15-cf4b1afa703d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:06.564453 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b5c5640-85ab-446b-9e15-cf4b1afa703d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:06.700243 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7b5c5640-85ab-446b-9e15-cf4b1afa703d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:06.708368 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7b5c5640-85ab-446b-9e15-cf4b1afa703d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:06.709893 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7b5c5640-85ab-446b-9e15-cf4b1afa703d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:06.711000 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7b5c5640-85ab-446b-9e15-cf4b1afa703d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1407 microversion: 2.20 time: 0.160136 Aug 24 11:34:06.711562 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 428/868] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:34:06 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:34:07.733942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3f7dbc45-748a-4d84-aa5f-964884ce08c8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:07.734548 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3f7dbc45-748a-4d84-aa5f-964884ce08c8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:07.741147 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f7dbc45-748a-4d84-aa5f-964884ce08c8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:07.741649 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f7dbc45-748a-4d84-aa5f-964884ce08c8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:07.742128 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f7dbc45-748a-4d84-aa5f-964884ce08c8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:07.742819 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f7dbc45-748a-4d84-aa5f-964884ce08c8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:07.743269 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f7dbc45-748a-4d84-aa5f-964884ce08c8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:07.743712 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f7dbc45-748a-4d84-aa5f-964884ce08c8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:07.871864 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3f7dbc45-748a-4d84-aa5f-964884ce08c8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:07.880101 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3f7dbc45-748a-4d84-aa5f-964884ce08c8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:07.881606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3f7dbc45-748a-4d84-aa5f-964884ce08c8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:07.882733 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3f7dbc45-748a-4d84-aa5f-964884ce08c8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1407 microversion: 2.20 time: 0.152802 Aug 24 11:34:07.883287 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 441/869] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:34:07 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:34:08.906146 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-28ca87cd-e250-49ba-98c3-5a280d4a6c71 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:08.906817 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-28ca87cd-e250-49ba-98c3-5a280d4a6c71 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:08.914272 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-28ca87cd-e250-49ba-98c3-5a280d4a6c71 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:08.914683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-28ca87cd-e250-49ba-98c3-5a280d4a6c71 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:08.915122 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-28ca87cd-e250-49ba-98c3-5a280d4a6c71 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:08.915863 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-28ca87cd-e250-49ba-98c3-5a280d4a6c71 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:08.916304 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-28ca87cd-e250-49ba-98c3-5a280d4a6c71 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:08.916729 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-28ca87cd-e250-49ba-98c3-5a280d4a6c71 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:09.207803 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-28ca87cd-e250-49ba-98c3-5a280d4a6c71 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:09.216944 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-28ca87cd-e250-49ba-98c3-5a280d4a6c71 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:09.219384 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-28ca87cd-e250-49ba-98c3-5a280d4a6c71 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:09.219682 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-28ca87cd-e250-49ba-98c3-5a280d4a6c71 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1407 microversion: 2.20 time: 0.317861 Aug 24 11:34:09.220223 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 429/870] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:34:08 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1407 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:34:10.242433 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8e997cf0-d076-4420-adb3-aca532e81768 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:10.243048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8e997cf0-d076-4420-adb3-aca532e81768 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:10.245406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:10.250207 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e997cf0-d076-4420-adb3-aca532e81768 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:10.250691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e997cf0-d076-4420-adb3-aca532e81768 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:10.251125 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e997cf0-d076-4420-adb3-aca532e81768 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:10.251807 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e997cf0-d076-4420-adb3-aca532e81768 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:10.252257 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e997cf0-d076-4420-adb3-aca532e81768 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:10.252710 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e997cf0-d076-4420-adb3-aca532e81768 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:10.381684 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8e997cf0-d076-4420-adb3-aca532e81768 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:10.390742 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8e997cf0-d076-4420-adb3-aca532e81768 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:10.392372 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8e997cf0-d076-4420-adb3-aca532e81768 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:10.393478 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8e997cf0-d076-4420-adb3-aca532e81768 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1407 microversion: 2.20 time: 0.154950 Aug 24 11:34:10.394065 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 442/871] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:34:10 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:34:10.889640 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-54aa346b-274a-46e7-81b3-032f3b4b6c4d req-7db8447f-3464-4842-8b1a-c1715fda0468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c6a206-49d7-44b6-a24f-f5961f099597", "name": "network-vif-plugged", "status": "completed", "tag": "dfa0d250-97f7-4d9a-9f1c-edee2d559865"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:10.895993 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:10.896659 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=6 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:10.902546 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-54aa346b-274a-46e7-81b3-032f3b4b6c4d req-7db8447f-3464-4842-8b1a-c1715fda0468 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:10.908005 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-54aa346b-274a-46e7-81b3-032f3b4b6c4d req-7db8447f-3464-4842-8b1a-c1715fda0468 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:10.908005 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-54aa346b-274a-46e7-81b3-032f3b4b6c4d req-7db8447f-3464-4842-8b1a-c1715fda0468 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:10.914479 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-54aa346b-274a-46e7-81b3-032f3b4b6c4d req-7db8447f-3464-4842-8b1a-c1715fda0468 service nova] Creating event network-vif-plugged:dfa0d250-97f7-4d9a-9f1c-edee2d559865 for instance 17c6a206-49d7-44b6-a24f-f5961f099597 on hv-cinder-85427 Aug 24 11:34:10.919571 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-54aa346b-274a-46e7-81b3-032f3b4b6c4d req-7db8447f-3464-4842-8b1a-c1715fda0468 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033678 Aug 24 11:34:10.920152 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 430/872] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:11.415607 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-449fbce7-db30-4de6-9b6f-91498757d462 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:11.416815 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-449fbce7-db30-4de6-9b6f-91498757d462 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:11.423331 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-449fbce7-db30-4de6-9b6f-91498757d462 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:11.430520 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-449fbce7-db30-4de6-9b6f-91498757d462 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:11.430520 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-449fbce7-db30-4de6-9b6f-91498757d462 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:11.430520 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-449fbce7-db30-4de6-9b6f-91498757d462 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:11.430520 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-449fbce7-db30-4de6-9b6f-91498757d462 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:11.430929 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-449fbce7-db30-4de6-9b6f-91498757d462 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:11.557018 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-449fbce7-db30-4de6-9b6f-91498757d462 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:11.565194 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-449fbce7-db30-4de6-9b6f-91498757d462 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:11.566727 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-449fbce7-db30-4de6-9b6f-91498757d462 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:11.567826 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-449fbce7-db30-4de6-9b6f-91498757d462 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1407 microversion: 2.20 time: 0.156121 Aug 24 11:34:11.568441 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 443/873] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:34:11 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:34:12.591614 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e2fc5618-43a9-42bb-8200-d6aa35e02be8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:12.592314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e2fc5618-43a9-42bb-8200-d6aa35e02be8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:12.599754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e2fc5618-43a9-42bb-8200-d6aa35e02be8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:12.600243 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e2fc5618-43a9-42bb-8200-d6aa35e02be8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:12.600680 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e2fc5618-43a9-42bb-8200-d6aa35e02be8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:12.601378 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e2fc5618-43a9-42bb-8200-d6aa35e02be8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:12.601834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e2fc5618-43a9-42bb-8200-d6aa35e02be8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:12.602284 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e2fc5618-43a9-42bb-8200-d6aa35e02be8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:12.739510 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e2fc5618-43a9-42bb-8200-d6aa35e02be8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:12.747792 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e2fc5618-43a9-42bb-8200-d6aa35e02be8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:12.749297 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e2fc5618-43a9-42bb-8200-d6aa35e02be8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:12.750431 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e2fc5618-43a9-42bb-8200-d6aa35e02be8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1407 microversion: 2.20 time: 0.164255 Aug 24 11:34:12.750991 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 431/874] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:34:12 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:34:13.773184 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-70e0e165-4240-4ed9-99ac-5033a322971b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:13.773760 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-70e0e165-4240-4ed9-99ac-5033a322971b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:13.781096 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70e0e165-4240-4ed9-99ac-5033a322971b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:13.781586 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70e0e165-4240-4ed9-99ac-5033a322971b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:13.782072 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70e0e165-4240-4ed9-99ac-5033a322971b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:13.782777 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70e0e165-4240-4ed9-99ac-5033a322971b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:13.783232 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70e0e165-4240-4ed9-99ac-5033a322971b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:13.783654 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70e0e165-4240-4ed9-99ac-5033a322971b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:13.910610 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-70e0e165-4240-4ed9-99ac-5033a322971b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:13.919669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-70e0e165-4240-4ed9-99ac-5033a322971b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:13.921196 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-70e0e165-4240-4ed9-99ac-5033a322971b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:13.922407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-70e0e165-4240-4ed9-99ac-5033a322971b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1599 microversion: 2.20 time: 0.153276 Aug 24 11:34:13.922970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 444/875] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:34:13 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:34:13.944065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3c8cdc3f-6fc7-4e7c-becd-d594f7124854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:13.949661 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3c8cdc3f-6fc7-4e7c-becd-d594f7124854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:13.950946 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3c8cdc3f-6fc7-4e7c-becd-d594f7124854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:13.951423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3c8cdc3f-6fc7-4e7c-becd-d594f7124854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:13.951850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3c8cdc3f-6fc7-4e7c-becd-d594f7124854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:13.952532 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3c8cdc3f-6fc7-4e7c-becd-d594f7124854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:13.952975 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3c8cdc3f-6fc7-4e7c-becd-d594f7124854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:13.953389 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3c8cdc3f-6fc7-4e7c-becd-d594f7124854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:14.031150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3c8cdc3f-6fc7-4e7c-becd-d594f7124854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091012 Aug 24 11:34:14.031736 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 432/876] 10.222.0.83 () {60 vars in 1316 bytes} [Wed Aug 24 11:34:13 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:34:15.162898 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-de7e3ed9-2a1b-409c-8466-27b4ca68910d req-9ee31644-9d2a-4dd3-aaae-afb788045f7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17c6a206-49d7-44b6-a24f-f5961f099597", "tag": "dfa0d250-97f7-4d9a-9f1c-edee2d559865"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:15.172903 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-de7e3ed9-2a1b-409c-8466-27b4ca68910d req-9ee31644-9d2a-4dd3-aaae-afb788045f7d service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:15.173383 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-de7e3ed9-2a1b-409c-8466-27b4ca68910d req-9ee31644-9d2a-4dd3-aaae-afb788045f7d service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:15.173816 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-de7e3ed9-2a1b-409c-8466-27b4ca68910d req-9ee31644-9d2a-4dd3-aaae-afb788045f7d service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:15.185702 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-de7e3ed9-2a1b-409c-8466-27b4ca68910d req-9ee31644-9d2a-4dd3-aaae-afb788045f7d service nova] Creating event network-changed:dfa0d250-97f7-4d9a-9f1c-edee2d559865 for instance 17c6a206-49d7-44b6-a24f-f5961f099597 on hv-cinder-85427 Aug 24 11:34:15.190764 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-de7e3ed9-2a1b-409c-8466-27b4ca68910d req-9ee31644-9d2a-4dd3-aaae-afb788045f7d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031484 Aug 24 11:34:15.191433 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 445/877] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:16.688050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7b4b1933-290c-45ea-9ce0-1dc942a014e0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:16.688590 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7b4b1933-290c-45ea-9ce0-1dc942a014e0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:16.694713 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b4b1933-290c-45ea-9ce0-1dc942a014e0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:16.695205 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b4b1933-290c-45ea-9ce0-1dc942a014e0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:16.695640 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b4b1933-290c-45ea-9ce0-1dc942a014e0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:16.696347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b4b1933-290c-45ea-9ce0-1dc942a014e0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:16.696802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b4b1933-290c-45ea-9ce0-1dc942a014e0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:16.697240 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7b4b1933-290c-45ea-9ce0-1dc942a014e0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:16.723534 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7b4b1933-290c-45ea-9ce0-1dc942a014e0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/ips" status: 200 len: 148 microversion: 2.1 time: 0.039956 Aug 24 11:34:16.724103 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 433/878] 10.222.0.83 () {58 vars in 1248 bytes} [Wed Aug 24 11:34:16 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:19.385356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ef9b83e4-e0f1-40aa-8d6a-fc3df5be7cd4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df24c99a-8b3b-46f5-8097-1fcfc07f2197"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:19.387880 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ef9b83e4-e0f1-40aa-8d6a-fc3df5be7cd4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:19.394427 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef9b83e4-e0f1-40aa-8d6a-fc3df5be7cd4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:19.395107 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef9b83e4-e0f1-40aa-8d6a-fc3df5be7cd4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:19.395324 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef9b83e4-e0f1-40aa-8d6a-fc3df5be7cd4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:19.396007 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef9b83e4-e0f1-40aa-8d6a-fc3df5be7cd4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:19.396458 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef9b83e4-e0f1-40aa-8d6a-fc3df5be7cd4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:19.396901 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef9b83e4-e0f1-40aa-8d6a-fc3df5be7cd4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:20.369708 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ef9b83e4-e0f1-40aa-8d6a-fc3df5be7cd4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "POST /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.988932 Aug 24 11:34:20.370956 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 446/879] 10.222.0.83 () {60 vars in 1323 bytes} [Wed Aug 24 11:34:19 2022] POST /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-volume_attachments => generated 194 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:28.954545 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4288fe62-7ed2-4c1d-b933-6ccd82207b44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df24c99a-8b3b-46f5-8097-1fcfc07f2197"}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:28.956951 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4288fe62-7ed2-4c1d-b933-6ccd82207b44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:28.959543 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:28.960197 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=48 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:28.965346 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4288fe62-7ed2-4c1d-b933-6ccd82207b44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:28.965819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4288fe62-7ed2-4c1d-b933-6ccd82207b44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:28.966272 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4288fe62-7ed2-4c1d-b933-6ccd82207b44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:28.966953 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4288fe62-7ed2-4c1d-b933-6ccd82207b44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:28.967400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4288fe62-7ed2-4c1d-b933-6ccd82207b44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:28.967815 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4288fe62-7ed2-4c1d-b933-6ccd82207b44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:29.048826 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-4288fe62-7ed2-4c1d-b933-6ccd82207b44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] HTTP exception thrown: Invalid volume: volume df24c99a-8b3b-46f5-8097-1fcfc07f2197 is already attached to instances: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4288fe62-7ed2-4c1d-b933-6ccd82207b44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Request method failure captured: Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: POST /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-volume_attachments HTTP/1.1 Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 74 Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgqETgNFLZN-cxtSDRr_AFoOlwFhwLX-ENYaVxJIHruplC9b_hdqfdtCiKQ8e38a_s-rndXFIgCY0GxucbSuzC9p3nENX8PLFIsqMQamCWy7Yc0bmYX9_A7TAaleaFSwaJqPHdkBljR5oJSERsZWj2B6SSpAFNzgXV0qWmNYC4EPrM8 Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:34:29.050683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:34:29.052306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6e41187605624091a4edc1993c4357e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6e41187605624091a4edc1993c4357e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:34:29.052306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:34:29.052306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:34:29.052306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:34:29.052306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:34:29.052306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:34:29.052306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:34:29.052306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 92712c36310c440c94da6c432c77a895 Aug 24 11:34:29.052306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:34:29.052306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Aug 24 11:34:29.052306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {"volumeAttachment": {"volumeId": "df24c99a-8b3b-46f5-8097-1fcfc07f2197"}} Aug 24 11:34:29.052306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Invalid volume: volume df24c99a-8b3b-46f5-8097-1fcfc07f2197 is already attached to instances: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'server_id': '9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2', 'body': {'volumeAttachment': {'volumeId': 'df24c99a-8b3b-46f5-8097-1fcfc07f2197'}}} Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume df24c99a-8b3b-46f5-8097-1fcfc07f2197 is already attached to instances: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:34:29.053147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume df24c99a-8b3b-46f5-8097-1fcfc07f2197 is already attached to instances: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:29.054397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:29.055633 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:29.055633 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:29.055633 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:29.055633 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume df24c99a-8b3b-46f5-8097-1fcfc07f2197 is already attached to instances: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 Aug 24 11:34:29.055633 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:34:29.055633 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4288fe62-7ed2-4c1d-b933-6ccd82207b44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Returning 400 to user: Invalid volume: volume df24c99a-8b3b-46f5-8097-1fcfc07f2197 is already attached to instances: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:29.055633 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4288fe62-7ed2-4c1d-b933-6ccd82207b44 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "POST /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101804 Aug 24 11:34:29.055633 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 434/880] 10.222.0.83 () {60 vars in 1323 bytes} [Wed Aug 24 11:34:28 2022] POST /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:34:29.117344 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-eaf3ac0c-3ada-4c71-b444-8c5223dbcdab tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:29.118183 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-eaf3ac0c-3ada-4c71-b444-8c5223dbcdab tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:29.125508 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eaf3ac0c-3ada-4c71-b444-8c5223dbcdab tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:29.126027 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eaf3ac0c-3ada-4c71-b444-8c5223dbcdab tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:29.126462 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eaf3ac0c-3ada-4c71-b444-8c5223dbcdab tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:29.127155 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eaf3ac0c-3ada-4c71-b444-8c5223dbcdab tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:29.127648 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eaf3ac0c-3ada-4c71-b444-8c5223dbcdab tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:29.128072 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eaf3ac0c-3ada-4c71-b444-8c5223dbcdab tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:29.209994 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-eaf3ac0c-3ada-4c71-b444-8c5223dbcdab tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lazy-loading 'services' on Instance uuid 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:34:29.428151 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-eaf3ac0c-3ada-4c71-b444-8c5223dbcdab tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-volume_attachments/df24c99a-8b3b-46f5-8097-1fcfc07f2197" status: 202 len: 0 microversion: 2.1 time: 0.314844 Aug 24 11:34:29.428740 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 447/881] 10.222.0.83 () {58 vars in 1416 bytes} [Wed Aug 24 11:34:29 2022] DELETE /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-volume_attachments/df24c99a-8b3b-46f5-8097-1fcfc07f2197 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:34:29.437605 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f55e4af0-3719-45c7-ba9b-6609bd4dc660 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:29.439760 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f55e4af0-3719-45c7-ba9b-6609bd4dc660 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:29.450657 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f55e4af0-3719-45c7-ba9b-6609bd4dc660 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:29.453004 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f55e4af0-3719-45c7-ba9b-6609bd4dc660 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:29.453004 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f55e4af0-3719-45c7-ba9b-6609bd4dc660 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:29.453004 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f55e4af0-3719-45c7-ba9b-6609bd4dc660 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:29.453004 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f55e4af0-3719-45c7-ba9b-6609bd4dc660 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:29.453445 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f55e4af0-3719-45c7-ba9b-6609bd4dc660 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:29.492399 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f55e4af0-3719-45c7-ba9b-6609bd4dc660 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059022 Aug 24 11:34:29.493024 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 435/882] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:34:29 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:30.505940 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f4b41f4d-4e9a-44a4-bdef-08fb28e5d56a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:30.508244 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f4b41f4d-4e9a-44a4-bdef-08fb28e5d56a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:30.515500 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4b41f4d-4e9a-44a4-bdef-08fb28e5d56a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:30.515999 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4b41f4d-4e9a-44a4-bdef-08fb28e5d56a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:30.516437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4b41f4d-4e9a-44a4-bdef-08fb28e5d56a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:30.517136 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4b41f4d-4e9a-44a4-bdef-08fb28e5d56a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:30.517590 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4b41f4d-4e9a-44a4-bdef-08fb28e5d56a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:30.518053 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4b41f4d-4e9a-44a4-bdef-08fb28e5d56a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:30.549007 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f4b41f4d-4e9a-44a4-bdef-08fb28e5d56a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047909 Aug 24 11:34:30.549627 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 448/883] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:34:30 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:31.562180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c89c7cd8-0636-4e7c-aa55-cdb1dbbef869 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:31.564300 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c89c7cd8-0636-4e7c-aa55-cdb1dbbef869 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:31.570735 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c89c7cd8-0636-4e7c-aa55-cdb1dbbef869 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:31.571231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c89c7cd8-0636-4e7c-aa55-cdb1dbbef869 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:31.571677 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c89c7cd8-0636-4e7c-aa55-cdb1dbbef869 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:31.572368 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c89c7cd8-0636-4e7c-aa55-cdb1dbbef869 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:31.572817 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c89c7cd8-0636-4e7c-aa55-cdb1dbbef869 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:31.573240 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c89c7cd8-0636-4e7c-aa55-cdb1dbbef869 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:31.601416 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c89c7cd8-0636-4e7c-aa55-cdb1dbbef869 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043155 Aug 24 11:34:31.601911 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 436/884] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:34:31 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:34:31.663321 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-441edeab-74b7-4ad2-93f8-bdf47f27d5e6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:31.663820 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-441edeab-74b7-4ad2-93f8-bdf47f27d5e6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:31.670545 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-441edeab-74b7-4ad2-93f8-bdf47f27d5e6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:31.671030 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-441edeab-74b7-4ad2-93f8-bdf47f27d5e6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:31.671469 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-441edeab-74b7-4ad2-93f8-bdf47f27d5e6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:31.672197 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-441edeab-74b7-4ad2-93f8-bdf47f27d5e6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:31.672618 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-441edeab-74b7-4ad2-93f8-bdf47f27d5e6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:31.673126 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-441edeab-74b7-4ad2-93f8-bdf47f27d5e6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:31.697703 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-441edeab-74b7-4ad2-93f8-bdf47f27d5e6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:34:31.730781 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:32.147833 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-441edeab-74b7-4ad2-93f8-bdf47f27d5e6 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 204 len: 0 microversion: 2.1 time: 0.487915 Aug 24 11:34:32.148429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 449/885] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:34:31 2022] DELETE /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:34:32.157360 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d3de95ed-9942-40ee-b2c9-2027ef68536b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:32.158663 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d3de95ed-9942-40ee-b2c9-2027ef68536b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:32.164930 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d3de95ed-9942-40ee-b2c9-2027ef68536b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:32.165423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d3de95ed-9942-40ee-b2c9-2027ef68536b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:32.165860 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d3de95ed-9942-40ee-b2c9-2027ef68536b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:32.166585 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d3de95ed-9942-40ee-b2c9-2027ef68536b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:32.167042 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d3de95ed-9942-40ee-b2c9-2027ef68536b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:32.167466 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d3de95ed-9942-40ee-b2c9-2027ef68536b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:32.299833 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d3de95ed-9942-40ee-b2c9-2027ef68536b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:32.307767 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d3de95ed-9942-40ee-b2c9-2027ef68536b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1679 microversion: 2.1 time: 0.154382 Aug 24 11:34:32.308338 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 437/886] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:32 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:33.329267 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b5f1332a-82f2-4c0b-9e3a-d5779b8fdb67 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:33.330039 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b5f1332a-82f2-4c0b-9e3a-d5779b8fdb67 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:33.336436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b5f1332a-82f2-4c0b-9e3a-d5779b8fdb67 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:33.336923 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b5f1332a-82f2-4c0b-9e3a-d5779b8fdb67 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:33.337365 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b5f1332a-82f2-4c0b-9e3a-d5779b8fdb67 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:33.338096 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b5f1332a-82f2-4c0b-9e3a-d5779b8fdb67 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:33.338550 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b5f1332a-82f2-4c0b-9e3a-d5779b8fdb67 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:33.338973 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b5f1332a-82f2-4c0b-9e3a-d5779b8fdb67 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:33.477253 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b5f1332a-82f2-4c0b-9e3a-d5779b8fdb67 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:33.485443 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b5f1332a-82f2-4c0b-9e3a-d5779b8fdb67 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1679 microversion: 2.1 time: 0.160413 Aug 24 11:34:33.486041 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 450/887] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:33 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:34.510481 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1d20f91f-f629-4cc9-8370-d762cf85d5f0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:34.511092 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1d20f91f-f629-4cc9-8370-d762cf85d5f0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:34.517436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d20f91f-f629-4cc9-8370-d762cf85d5f0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:34.517976 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d20f91f-f629-4cc9-8370-d762cf85d5f0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:34.518410 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d20f91f-f629-4cc9-8370-d762cf85d5f0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:34.519098 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d20f91f-f629-4cc9-8370-d762cf85d5f0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:34.519548 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d20f91f-f629-4cc9-8370-d762cf85d5f0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:34.519968 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d20f91f-f629-4cc9-8370-d762cf85d5f0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:34.752920 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1d20f91f-f629-4cc9-8370-d762cf85d5f0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:34.761348 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1d20f91f-f629-4cc9-8370-d762cf85d5f0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1679 microversion: 2.1 time: 0.255779 Aug 24 11:34:34.762235 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 438/888] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:34 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:35.535693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-a0f2e4cc-8ead-456e-91cf-216081a56b3a req-5000d2bf-ef49-4e41-88d2-377fe1fe0c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2", "name": "network-vif-deleted", "tag": "2d1ddad6-43a4-4d02-bfd5-d1a80c55b4a0"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:35.542360 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:35.547527 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-a0f2e4cc-8ead-456e-91cf-216081a56b3a req-5000d2bf-ef49-4e41-88d2-377fe1fe0c79 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:35.548001 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-a0f2e4cc-8ead-456e-91cf-216081a56b3a req-5000d2bf-ef49-4e41-88d2-377fe1fe0c79 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:35.548426 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-a0f2e4cc-8ead-456e-91cf-216081a56b3a req-5000d2bf-ef49-4e41-88d2-377fe1fe0c79 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:35.559450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-a0f2e4cc-8ead-456e-91cf-216081a56b3a req-5000d2bf-ef49-4e41-88d2-377fe1fe0c79 service nova] Creating event network-vif-deleted:2d1ddad6-43a4-4d02-bfd5-d1a80c55b4a0 for instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 on hv-cinder-85427 Aug 24 11:34:35.564536 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-a0f2e4cc-8ead-456e-91cf-216081a56b3a req-5000d2bf-ef49-4e41-88d2-377fe1fe0c79 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032478 Aug 24 11:34:35.565149 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 451/889] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:35.782160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8cd4e71f-11f2-4471-bbc3-e25052005e4e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:35.782679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8cd4e71f-11f2-4471-bbc3-e25052005e4e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:35.789069 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8cd4e71f-11f2-4471-bbc3-e25052005e4e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:35.789605 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8cd4e71f-11f2-4471-bbc3-e25052005e4e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:35.790076 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8cd4e71f-11f2-4471-bbc3-e25052005e4e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:35.790915 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8cd4e71f-11f2-4471-bbc3-e25052005e4e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:35.791486 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8cd4e71f-11f2-4471-bbc3-e25052005e4e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:35.791910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8cd4e71f-11f2-4471-bbc3-e25052005e4e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:35.856260 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8cd4e71f-11f2-4471-bbc3-e25052005e4e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:35.864225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8cd4e71f-11f2-4471-bbc3-e25052005e4e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 200 len: 1325 microversion: 2.1 time: 0.086465 Aug 24 11:34:35.876448 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 439/890] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:35 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 1325 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:36.887638 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-212c2ced-b062-4c11-af14-c5aa46d9192e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:36.888332 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-212c2ced-b062-4c11-af14-c5aa46d9192e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:36.895177 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-212c2ced-b062-4c11-af14-c5aa46d9192e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:36.895653 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-212c2ced-b062-4c11-af14-c5aa46d9192e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:36.896087 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-212c2ced-b062-4c11-af14-c5aa46d9192e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:36.896759 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-212c2ced-b062-4c11-af14-c5aa46d9192e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:36.897206 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-212c2ced-b062-4c11-af14-c5aa46d9192e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:36.897619 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-212c2ced-b062-4c11-af14-c5aa46d9192e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:36.911381 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-212c2ced-b062-4c11-af14-c5aa46d9192e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] HTTP exception thrown: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-212c2ced-b062-4c11-af14-c5aa46d9192e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Request method failure captured: Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 HTTP/1.1 Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgqETgNFLZN-cxtSDRr_AFoOlwFhwLX-ENYaVxJIHruplC9b_hdqfdtCiKQ8e38a_s-rndXFIgCY0GxucbSuzC9p3nENX8PLFIsqMQamCWy7Yc0bmYX9_A7TAaleaFSwaJqPHdkBljR5oJSERsZWj2B6SSpAFNzgXV0qWmNYC4EPrM8 Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:34:36.912995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:34:36.914584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6e41187605624091a4edc1993c4357e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6e41187605624091a4edc1993c4357e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:34:36.914584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:34:36.914584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:34:36.914584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:34:36.914584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:34:36.914584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:34:36.914584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:34:36.914584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 92712c36310c440c94da6c432c77a895 Aug 24 11:34:36.914584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:34:36.914584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:34:36.914584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:34:36.914584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2'} Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:36.915581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:34:36.917161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:34:36.918520 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-212c2ced-b062-4c11-af14-c5aa46d9192e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Returning 404 to user: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:36.918520 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-212c2ced-b062-4c11-af14-c5aa46d9192e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 404 len: 111 microversion: 2.1 time: 0.031970 Aug 24 11:34:36.918520 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 452/891] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:36 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 11:34:36.923520 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-99c1f1f1-f8ff-4872-961a-384d153c254e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '.version_select at 0x7f723cd5f8b0>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:36.999907 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-99c1f1f1-f8ff-4872-961a-384d153c254e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-106925069" status: 202 len: 0 microversion: 2.1 time: 0.080203 Aug 24 11:34:37.000495 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 440/892] 10.222.0.83 () {58 vars in 1218 bytes} [Wed Aug 24 11:34:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-106925069 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:34:37.860085 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cbf972c0-61c8-4c82-ac58-c0a1c432a430 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Action: 'create', calling method: .version_select at 0x7f7241fe90d0>, body: {"keypair": {"name": "tempest-keypair-2059875554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpSjHpmLKjO6r3QiDpOMwnKveQW7YtElnJNdUr0fP3V2jCerFxC4pi91tylZgm2pQFpsaOYusbiIRvFqZJBFqxB7xzVo8PaDKTsULMmDbFa6oaiOWqeXrTMhHXLBm9p7w=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:37.876120 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-cbf972c0-61c8-4c82-ac58-c0a1c432a430 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for project 6e41187605624091a4edc1993c4357e4. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:34:37.880027 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-cbf972c0-61c8-4c82-ac58-c0a1c432a430 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for user 92712c36310c440c94da6c432c77a895 and project 6e41187605624091a4edc1993c4357e4. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:34:37.994545 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cbf972c0-61c8-4c82-ac58-c0a1c432a430 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138197 Aug 24 11:34:37.995191 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 453/893] 10.222.0.83 () {60 vars in 1159 bytes} [Wed Aug 24 11:34:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:34:40.470280 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-185643903", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e65e35e5-b291-45e0-99cd-ea04855e4be5"}], "security_groups": [{"name": "tempest-securitygroup--1084041994"}], "key_name": "tempest-keypair-2059875554", "user_data": "}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:40.579845 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] validate_networks() for [('e65e35e5-b291-45e0-99cd-ea04855e4be5', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:34:40.954208 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:34:40.954615 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:34:40.955089 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:34:40.955497 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:34:40.955904 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:34:40.965248 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:40.965723 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:40.966187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:40.966904 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:40.967358 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:40.967776 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:40.984695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for project 6e41187605624091a4edc1993c4357e4. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:34:40.988628 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Getting quotas for user 92712c36310c440c94da6c432c77a895 and project 6e41187605624091a4edc1993c4357e4. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:34:40.999482 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:34:41.001762 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:34:41.189535 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1fb6a0f6-6950-47ab-b81c-522845c81c6f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.723672 Aug 24 11:34:41.190220 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 441/894] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:34:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:34:41.202282 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0e3ae0c7-8f3d-4de0-9514-388bced330a5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:41.202794 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0e3ae0c7-8f3d-4de0-9514-388bced330a5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:41.427958 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0e3ae0c7-8f3d-4de0-9514-388bced330a5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:41.435602 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0e3ae0c7-8f3d-4de0-9514-388bced330a5 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1241 microversion: 2.1 time: 0.237919 Aug 24 11:34:41.436152 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 454/895] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:41 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1241 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:42.457847 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d664c410-de7c-4c28-b37b-43da031a0100 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:42.458429 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d664c410-de7c-4c28-b37b-43da031a0100 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:42.465105 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d664c410-de7c-4c28-b37b-43da031a0100 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:42.465596 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d664c410-de7c-4c28-b37b-43da031a0100 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:42.466063 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d664c410-de7c-4c28-b37b-43da031a0100 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:42.466836 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d664c410-de7c-4c28-b37b-43da031a0100 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:42.467853 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d664c410-de7c-4c28-b37b-43da031a0100 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:42.468341 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d664c410-de7c-4c28-b37b-43da031a0100 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:42.592891 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d664c410-de7c-4c28-b37b-43da031a0100 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:42.599312 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d664c410-de7c-4c28-b37b-43da031a0100 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1237 microversion: 2.1 time: 0.146306 Aug 24 11:34:42.599885 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 442/896] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:42 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1237 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:43.620813 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-eccfb7de-cbfb-46a7-b4d6-13f69edc5c15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:43.621453 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-eccfb7de-cbfb-46a7-b4d6-13f69edc5c15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:43.628308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eccfb7de-cbfb-46a7-b4d6-13f69edc5c15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:43.628640 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eccfb7de-cbfb-46a7-b4d6-13f69edc5c15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:43.629089 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eccfb7de-cbfb-46a7-b4d6-13f69edc5c15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:43.629793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eccfb7de-cbfb-46a7-b4d6-13f69edc5c15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:43.630277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eccfb7de-cbfb-46a7-b4d6-13f69edc5c15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:43.630726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eccfb7de-cbfb-46a7-b4d6-13f69edc5c15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:43.693752 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-eccfb7de-cbfb-46a7-b4d6-13f69edc5c15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:43.701850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-eccfb7de-cbfb-46a7-b4d6-13f69edc5c15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1301 microversion: 2.1 time: 0.085385 Aug 24 11:34:43.702455 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 455/897] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:43 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:44.723539 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a872ecc7-12ea-4467-80dc-070ad67ab7a4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:44.724146 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a872ecc7-12ea-4467-80dc-070ad67ab7a4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:44.731412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a872ecc7-12ea-4467-80dc-070ad67ab7a4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:44.731931 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a872ecc7-12ea-4467-80dc-070ad67ab7a4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:44.732442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a872ecc7-12ea-4467-80dc-070ad67ab7a4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:44.733150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a872ecc7-12ea-4467-80dc-070ad67ab7a4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:44.733610 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a872ecc7-12ea-4467-80dc-070ad67ab7a4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:44.734065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a872ecc7-12ea-4467-80dc-070ad67ab7a4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:44.950600 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a872ecc7-12ea-4467-80dc-070ad67ab7a4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:44.958437 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a872ecc7-12ea-4467-80dc-070ad67ab7a4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1367 microversion: 2.1 time: 0.238789 Aug 24 11:34:44.962829 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 443/898] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:44 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:45.549740 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-8826c050-05f6-46bf-9488-c2e77b0e9d55 req-15037f22-6d82-4bc5-901f-7780db925ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228d2379-c4ae-4cf8-81bd-0fa2f4d418ba", "tag": "4b482463-7461-41c3-860d-731d3f9a6c27"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:45.560344 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8826c050-05f6-46bf-9488-c2e77b0e9d55 req-15037f22-6d82-4bc5-901f-7780db925ca7 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:45.560853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8826c050-05f6-46bf-9488-c2e77b0e9d55 req-15037f22-6d82-4bc5-901f-7780db925ca7 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:45.561281 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8826c050-05f6-46bf-9488-c2e77b0e9d55 req-15037f22-6d82-4bc5-901f-7780db925ca7 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:45.572896 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-8826c050-05f6-46bf-9488-c2e77b0e9d55 req-15037f22-6d82-4bc5-901f-7780db925ca7 service nova] Creating event network-changed:4b482463-7461-41c3-860d-731d3f9a6c27 for instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba on hv-cinder-85427 Aug 24 11:34:45.577894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-8826c050-05f6-46bf-9488-c2e77b0e9d55 req-15037f22-6d82-4bc5-901f-7780db925ca7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033249 Aug 24 11:34:45.578507 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 456/899] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:34:45.981066 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d210f16b-58e4-4a65-811f-360989ab4eb7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:45.981692 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d210f16b-58e4-4a65-811f-360989ab4eb7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:45.990065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d210f16b-58e4-4a65-811f-360989ab4eb7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:45.993455 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d210f16b-58e4-4a65-811f-360989ab4eb7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:45.993455 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d210f16b-58e4-4a65-811f-360989ab4eb7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:45.993455 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d210f16b-58e4-4a65-811f-360989ab4eb7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:45.993455 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d210f16b-58e4-4a65-811f-360989ab4eb7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:45.993961 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d210f16b-58e4-4a65-811f-360989ab4eb7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:46.205037 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d210f16b-58e4-4a65-811f-360989ab4eb7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:46.213704 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d210f16b-58e4-4a65-811f-360989ab4eb7 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1367 microversion: 2.1 time: 0.237179 Aug 24 11:34:46.214320 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 444/900] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:45 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:47.235483 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-477522e3-eb8d-4d3e-ae48-962f233bfb15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:47.236191 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-477522e3-eb8d-4d3e-ae48-962f233bfb15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:47.242348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-477522e3-eb8d-4d3e-ae48-962f233bfb15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:47.242830 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-477522e3-eb8d-4d3e-ae48-962f233bfb15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:47.243264 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-477522e3-eb8d-4d3e-ae48-962f233bfb15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:47.243957 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-477522e3-eb8d-4d3e-ae48-962f233bfb15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:47.244409 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-477522e3-eb8d-4d3e-ae48-962f233bfb15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:47.244833 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-477522e3-eb8d-4d3e-ae48-962f233bfb15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:47.377727 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-477522e3-eb8d-4d3e-ae48-962f233bfb15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:47.386213 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-477522e3-eb8d-4d3e-ae48-962f233bfb15 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1367 microversion: 2.1 time: 0.155234 Aug 24 11:34:47.386785 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 457/901] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:47 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:48.407635 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f3c8afb0-f1d9-4f70-aa7b-afcec1a1b2aa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:48.408277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f3c8afb0-f1d9-4f70-aa7b-afcec1a1b2aa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:48.415332 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f3c8afb0-f1d9-4f70-aa7b-afcec1a1b2aa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:48.415822 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f3c8afb0-f1d9-4f70-aa7b-afcec1a1b2aa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:48.416254 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f3c8afb0-f1d9-4f70-aa7b-afcec1a1b2aa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:48.416948 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f3c8afb0-f1d9-4f70-aa7b-afcec1a1b2aa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:48.417423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f3c8afb0-f1d9-4f70-aa7b-afcec1a1b2aa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:48.417847 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f3c8afb0-f1d9-4f70-aa7b-afcec1a1b2aa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:48.555064 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f3c8afb0-f1d9-4f70-aa7b-afcec1a1b2aa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:48.562345 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f3c8afb0-f1d9-4f70-aa7b-afcec1a1b2aa tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1367 microversion: 2.1 time: 0.158606 Aug 24 11:34:48.562908 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 445/902] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:48 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:49.583167 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1b90c459-5438-4370-9f81-7f55f8e99360 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:49.583855 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1b90c459-5438-4370-9f81-7f55f8e99360 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:49.590342 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b90c459-5438-4370-9f81-7f55f8e99360 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:49.590838 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b90c459-5438-4370-9f81-7f55f8e99360 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:49.591275 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b90c459-5438-4370-9f81-7f55f8e99360 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:49.591969 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b90c459-5438-4370-9f81-7f55f8e99360 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:49.592431 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b90c459-5438-4370-9f81-7f55f8e99360 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:49.592854 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b90c459-5438-4370-9f81-7f55f8e99360 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:49.723804 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1b90c459-5438-4370-9f81-7f55f8e99360 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:49.732119 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1b90c459-5438-4370-9f81-7f55f8e99360 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1367 microversion: 2.1 time: 0.152757 Aug 24 11:34:49.732697 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 458/903] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:49 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:50.752814 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-823c7426-9737-4f77-b551-24496ded9c2f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:50.753427 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-823c7426-9737-4f77-b551-24496ded9c2f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:50.760514 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-823c7426-9737-4f77-b551-24496ded9c2f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:50.761008 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-823c7426-9737-4f77-b551-24496ded9c2f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:50.761464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-823c7426-9737-4f77-b551-24496ded9c2f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:50.762202 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-823c7426-9737-4f77-b551-24496ded9c2f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:50.762666 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-823c7426-9737-4f77-b551-24496ded9c2f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:50.763093 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-823c7426-9737-4f77-b551-24496ded9c2f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:50.812370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fdf5eb9c-b040-4664-85a3-05bd18b07e08 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:50.813184 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fdf5eb9c-b040-4664-85a3-05bd18b07e08 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:50.828018 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdf5eb9c-b040-4664-85a3-05bd18b07e08 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:50.828621 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdf5eb9c-b040-4664-85a3-05bd18b07e08 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:50.829063 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdf5eb9c-b040-4664-85a3-05bd18b07e08 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:50.829771 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdf5eb9c-b040-4664-85a3-05bd18b07e08 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:50.830433 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdf5eb9c-b040-4664-85a3-05bd18b07e08 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:50.830861 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdf5eb9c-b040-4664-85a3-05bd18b07e08 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:50.857834 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fdf5eb9c-b040-4664-85a3-05bd18b07e08 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:34:50.915164 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-823c7426-9737-4f77-b551-24496ded9c2f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:50.923421 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-823c7426-9737-4f77-b551-24496ded9c2f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1367 microversion: 2.1 time: 0.174560 Aug 24 11:34:50.924006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 446/904] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:50 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:50.942721 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-08827252-3c76-4442-832d-25e0e288ccd5 req-b1b6afd7-d0f9-4002-a4f4-a4c7fd7bd888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b6e400-1d49-417d-9140-692da71f9da6", "tag": "c09687c1-5de4-4274-b42a-5caf8a2d5adb"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:50.957015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-08827252-3c76-4442-832d-25e0e288ccd5 req-b1b6afd7-d0f9-4002-a4f4-a4c7fd7bd888 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:50.961657 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-08827252-3c76-4442-832d-25e0e288ccd5 req-b1b6afd7-d0f9-4002-a4f4-a4c7fd7bd888 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:50.961657 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-08827252-3c76-4442-832d-25e0e288ccd5 req-b1b6afd7-d0f9-4002-a4f4-a4c7fd7bd888 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:50.971180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-08827252-3c76-4442-832d-25e0e288ccd5 req-b1b6afd7-d0f9-4002-a4f4-a4c7fd7bd888 service nova] Creating event network-changed:c09687c1-5de4-4274-b42a-5caf8a2d5adb for instance a9b6e400-1d49-417d-9140-692da71f9da6 on hv-cinder-85427 Aug 24 11:34:50.976547 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-08827252-3c76-4442-832d-25e0e288ccd5 req-b1b6afd7-d0f9-4002-a4f4-a4c7fd7bd888 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038677 Aug 24 11:34:50.977154 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 447/905] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:51.221375 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fdf5eb9c-b040-4664-85a3-05bd18b07e08 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 204 len: 0 microversion: 2.1 time: 0.412900 Aug 24 11:34:51.228307 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 459/906] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:34:50 2022] DELETE /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:34:51.233613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ece145ab-f66e-4adf-bdfd-a37bacb59062 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:51.234367 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ece145ab-f66e-4adf-bdfd-a37bacb59062 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:51.236360 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:51.237195 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=6 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:51.243843 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ece145ab-f66e-4adf-bdfd-a37bacb59062 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:51.244343 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ece145ab-f66e-4adf-bdfd-a37bacb59062 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:51.244760 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ece145ab-f66e-4adf-bdfd-a37bacb59062 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:51.245453 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ece145ab-f66e-4adf-bdfd-a37bacb59062 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:51.245923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ece145ab-f66e-4adf-bdfd-a37bacb59062 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:51.246355 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ece145ab-f66e-4adf-bdfd-a37bacb59062 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:51.392232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ece145ab-f66e-4adf-bdfd-a37bacb59062 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:51.401217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ece145ab-f66e-4adf-bdfd-a37bacb59062 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.172140 Aug 24 11:34:51.402492 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 448/907] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:51 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:51.467714 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-10f54181-3b3f-48bc-9039-08ca84ff6813 req-46b1c6ce-46e5-461a-aa05-edc4313c86b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228d2379-c4ae-4cf8-81bd-0fa2f4d418ba", "name": "network-vif-plugged", "status": "completed", "tag": "4b482463-7461-41c3-860d-731d3f9a6c27"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:51.472948 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:51.479324 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-10f54181-3b3f-48bc-9039-08ca84ff6813 req-46b1c6ce-46e5-461a-aa05-edc4313c86b1 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:51.479324 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-10f54181-3b3f-48bc-9039-08ca84ff6813 req-46b1c6ce-46e5-461a-aa05-edc4313c86b1 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:51.479732 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-10f54181-3b3f-48bc-9039-08ca84ff6813 req-46b1c6ce-46e5-461a-aa05-edc4313c86b1 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:51.491122 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-10f54181-3b3f-48bc-9039-08ca84ff6813 req-46b1c6ce-46e5-461a-aa05-edc4313c86b1 service nova] Creating event network-vif-plugged:4b482463-7461-41c3-860d-731d3f9a6c27 for instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba on hv-cinder-85427 Aug 24 11:34:51.496131 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-10f54181-3b3f-48bc-9039-08ca84ff6813 req-46b1c6ce-46e5-461a-aa05-edc4313c86b1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032507 Aug 24 11:34:51.496733 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 460/908] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:51.947919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-df6e7f04-b4ec-4f1a-be0b-a4394eb1609e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:51.948551 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-df6e7f04-b4ec-4f1a-be0b-a4394eb1609e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:51.955265 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-df6e7f04-b4ec-4f1a-be0b-a4394eb1609e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:51.955782 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-df6e7f04-b4ec-4f1a-be0b-a4394eb1609e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:51.956835 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-df6e7f04-b4ec-4f1a-be0b-a4394eb1609e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:51.957554 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-df6e7f04-b4ec-4f1a-be0b-a4394eb1609e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:51.958047 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-df6e7f04-b4ec-4f1a-be0b-a4394eb1609e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:51.958478 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-df6e7f04-b4ec-4f1a-be0b-a4394eb1609e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:52.092111 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-df6e7f04-b4ec-4f1a-be0b-a4394eb1609e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:52.099922 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-df6e7f04-b4ec-4f1a-be0b-a4394eb1609e tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1367 microversion: 2.1 time: 0.156508 Aug 24 11:34:52.100487 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 449/909] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:51 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:52.426455 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-49392734-1ea3-48e8-aeae-d30076fb92b9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:52.427160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-49392734-1ea3-48e8-aeae-d30076fb92b9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:52.433585 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49392734-1ea3-48e8-aeae-d30076fb92b9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:52.434177 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49392734-1ea3-48e8-aeae-d30076fb92b9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:52.434620 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49392734-1ea3-48e8-aeae-d30076fb92b9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:52.435318 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49392734-1ea3-48e8-aeae-d30076fb92b9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:52.435764 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49392734-1ea3-48e8-aeae-d30076fb92b9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:52.436242 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49392734-1ea3-48e8-aeae-d30076fb92b9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:52.580296 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-49392734-1ea3-48e8-aeae-d30076fb92b9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:52.588591 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-49392734-1ea3-48e8-aeae-d30076fb92b9 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1567 microversion: 2.1 time: 0.167533 Aug 24 11:34:52.589155 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 461/910] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:52 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:34:53.185861 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c446d0f7-9b31-4e88-8be2-6318956c424a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:53.186507 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c446d0f7-9b31-4e88-8be2-6318956c424a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:53.192542 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c446d0f7-9b31-4e88-8be2-6318956c424a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:53.193058 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c446d0f7-9b31-4e88-8be2-6318956c424a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:53.193499 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c446d0f7-9b31-4e88-8be2-6318956c424a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:53.194228 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c446d0f7-9b31-4e88-8be2-6318956c424a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:53.194704 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c446d0f7-9b31-4e88-8be2-6318956c424a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:53.195404 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c446d0f7-9b31-4e88-8be2-6318956c424a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:53.338725 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c446d0f7-9b31-4e88-8be2-6318956c424a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:53.348031 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c446d0f7-9b31-4e88-8be2-6318956c424a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1367 microversion: 2.1 time: 0.231726 Aug 24 11:34:53.348856 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 450/911] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:53 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:53.611695 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2b93c96e-da61-4b80-9efa-8b8867ac6a7a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:53.612309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2b93c96e-da61-4b80-9efa-8b8867ac6a7a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:53.618961 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b93c96e-da61-4b80-9efa-8b8867ac6a7a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:53.619452 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b93c96e-da61-4b80-9efa-8b8867ac6a7a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:53.620248 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b93c96e-da61-4b80-9efa-8b8867ac6a7a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:53.620623 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b93c96e-da61-4b80-9efa-8b8867ac6a7a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:53.621081 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b93c96e-da61-4b80-9efa-8b8867ac6a7a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:53.621502 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b93c96e-da61-4b80-9efa-8b8867ac6a7a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:53.899191 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2b93c96e-da61-4b80-9efa-8b8867ac6a7a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:53.907128 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2b93c96e-da61-4b80-9efa-8b8867ac6a7a tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1448 microversion: 2.1 time: 0.299376 Aug 24 11:34:53.907682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 462/912] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:53 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1448 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:54.370119 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1bdb4342-fade-47e3-baa6-52af0e694b5a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:54.373126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1bdb4342-fade-47e3-baa6-52af0e694b5a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:54.377957 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1bdb4342-fade-47e3-baa6-52af0e694b5a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:54.378465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1bdb4342-fade-47e3-baa6-52af0e694b5a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:54.378901 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1bdb4342-fade-47e3-baa6-52af0e694b5a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:54.379601 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1bdb4342-fade-47e3-baa6-52af0e694b5a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:54.380054 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1bdb4342-fade-47e3-baa6-52af0e694b5a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:54.380510 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1bdb4342-fade-47e3-baa6-52af0e694b5a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:54.496893 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-62b70e1c-dadc-4d0c-b1cd-68c137de3f01 req-c0a593d8-0d99-4ddf-8349-01cf13b83825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b6e400-1d49-417d-9140-692da71f9da6", "name": "network-vif-deleted", "tag": "c09687c1-5de4-4274-b42a-5caf8a2d5adb"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:54.506295 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-62b70e1c-dadc-4d0c-b1cd-68c137de3f01 req-c0a593d8-0d99-4ddf-8349-01cf13b83825 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:54.506770 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-62b70e1c-dadc-4d0c-b1cd-68c137de3f01 req-c0a593d8-0d99-4ddf-8349-01cf13b83825 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:54.507198 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-62b70e1c-dadc-4d0c-b1cd-68c137de3f01 req-c0a593d8-0d99-4ddf-8349-01cf13b83825 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:54.519700 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-62b70e1c-dadc-4d0c-b1cd-68c137de3f01 req-c0a593d8-0d99-4ddf-8349-01cf13b83825 service nova] Creating event network-vif-deleted:c09687c1-5de4-4274-b42a-5caf8a2d5adb for instance a9b6e400-1d49-417d-9140-692da71f9da6 on hv-cinder-85427 Aug 24 11:34:54.524810 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-62b70e1c-dadc-4d0c-b1cd-68c137de3f01 req-c0a593d8-0d99-4ddf-8349-01cf13b83825 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032780 Aug 24 11:34:54.525437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 463/913] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:54.557285 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1bdb4342-fade-47e3-baa6-52af0e694b5a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:54.564993 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1bdb4342-fade-47e3-baa6-52af0e694b5a tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1367 microversion: 2.1 time: 0.199538 Aug 24 11:34:54.565552 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 451/914] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:54 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:54.929280 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4cbdd148-ef16-4d2c-9ff5-ffd1460ebbe1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:54.930063 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4cbdd148-ef16-4d2c-9ff5-ffd1460ebbe1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:54.936636 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cbdd148-ef16-4d2c-9ff5-ffd1460ebbe1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:54.937113 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cbdd148-ef16-4d2c-9ff5-ffd1460ebbe1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:54.937544 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cbdd148-ef16-4d2c-9ff5-ffd1460ebbe1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:54.938251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cbdd148-ef16-4d2c-9ff5-ffd1460ebbe1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:54.938742 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cbdd148-ef16-4d2c-9ff5-ffd1460ebbe1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:54.939157 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cbdd148-ef16-4d2c-9ff5-ffd1460ebbe1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:54.987036 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:34:54.987261 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:34:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 (ip 10.222.0.83) !!! Aug 24 11:34:55.007188 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4cbdd148-ef16-4d2c-9ff5-ffd1460ebbe1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:55.015692 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4cbdd148-ef16-4d2c-9ff5-ffd1460ebbe1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1218 microversion: 2.1 time: 0.090713 Aug 24 11:34:55.016243 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 464/915] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:54 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:55.585619 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8450e322-47ef-4015-8823-9eebc6a5de78 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:55.586737 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8450e322-47ef-4015-8823-9eebc6a5de78 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:55.593263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8450e322-47ef-4015-8823-9eebc6a5de78 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:55.593747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8450e322-47ef-4015-8823-9eebc6a5de78 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:55.594222 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8450e322-47ef-4015-8823-9eebc6a5de78 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:55.594917 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8450e322-47ef-4015-8823-9eebc6a5de78 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:55.595371 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8450e322-47ef-4015-8823-9eebc6a5de78 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:55.595792 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8450e322-47ef-4015-8823-9eebc6a5de78 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:55.731686 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8450e322-47ef-4015-8823-9eebc6a5de78 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:55.735112 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=100 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:34:55.739598 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8450e322-47ef-4015-8823-9eebc6a5de78 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1367 microversion: 2.1 time: 0.157955 Aug 24 11:34:55.740166 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 452/916] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:55 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:56.036734 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-eed5396e-9d85-4635-8397-368300cb0f6e tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:56.037343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-eed5396e-9d85-4635-8397-368300cb0f6e tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:56.043944 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eed5396e-9d85-4635-8397-368300cb0f6e tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:56.044454 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eed5396e-9d85-4635-8397-368300cb0f6e tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:56.044889 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eed5396e-9d85-4635-8397-368300cb0f6e tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:56.045582 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eed5396e-9d85-4635-8397-368300cb0f6e tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:56.046064 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eed5396e-9d85-4635-8397-368300cb0f6e tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:56.046485 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eed5396e-9d85-4635-8397-368300cb0f6e tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:56.108766 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-eed5396e-9d85-4635-8397-368300cb0f6e tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1971caade1b4c34a6c69c600070bc5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac977e5066e413c9e9cc06b5a012fdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:56.116702 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-eed5396e-9d85-4635-8397-368300cb0f6e tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 200 len: 1218 microversion: 2.1 time: 0.083855 Aug 24 11:34:56.117266 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 465/917] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:56 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:56.762258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a8017500-75ed-4030-aa73-3c5fe5ade350 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:56.763086 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a8017500-75ed-4030-aa73-3c5fe5ade350 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:56.769957 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a8017500-75ed-4030-aa73-3c5fe5ade350 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:56.770440 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a8017500-75ed-4030-aa73-3c5fe5ade350 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:56.770881 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a8017500-75ed-4030-aa73-3c5fe5ade350 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:56.771569 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a8017500-75ed-4030-aa73-3c5fe5ade350 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:56.772020 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a8017500-75ed-4030-aa73-3c5fe5ade350 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:56.772442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a8017500-75ed-4030-aa73-3c5fe5ade350 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:56.906988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a8017500-75ed-4030-aa73-3c5fe5ade350 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:34:56.914825 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a8017500-75ed-4030-aa73-3c5fe5ade350 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1557 microversion: 2.1 time: 0.157357 Aug 24 11:34:56.915386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 453/918] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:56 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:34:56.935139 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0310c9ca-7793-4aad-aca3-6458cd3298d3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:56.935547 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0310c9ca-7793-4aad-aca3-6458cd3298d3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:56.941753 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0310c9ca-7793-4aad-aca3-6458cd3298d3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:56.942284 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0310c9ca-7793-4aad-aca3-6458cd3298d3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:56.942720 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0310c9ca-7793-4aad-aca3-6458cd3298d3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:56.943440 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0310c9ca-7793-4aad-aca3-6458cd3298d3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:56.943895 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0310c9ca-7793-4aad-aca3-6458cd3298d3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:56.944313 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0310c9ca-7793-4aad-aca3-6458cd3298d3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:57.034275 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0310c9ca-7793-4aad-aca3-6458cd3298d3 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102988 Aug 24 11:34:57.034880 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 466/919] 10.222.0.83 () {58 vars in 1275 bytes} [Wed Aug 24 11:34:56 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:34:57.138459 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f97a3d13-b927-4f81-9df8-ebd55efeb6f1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:57.138459 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f97a3d13-b927-4f81-9df8-ebd55efeb6f1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] [instance: a9b6e400-1d49-417d-9140-692da71f9da6] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:57.144454 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f97a3d13-b927-4f81-9df8-ebd55efeb6f1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:57.144965 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f97a3d13-b927-4f81-9df8-ebd55efeb6f1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:57.145398 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f97a3d13-b927-4f81-9df8-ebd55efeb6f1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:57.146146 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f97a3d13-b927-4f81-9df8-ebd55efeb6f1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:57.146603 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f97a3d13-b927-4f81-9df8-ebd55efeb6f1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:57.147194 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f97a3d13-b927-4f81-9df8-ebd55efeb6f1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:57.161226 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-f97a3d13-b927-4f81-9df8-ebd55efeb6f1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] HTTP exception thrown: Instance a9b6e400-1d49-417d-9140-692da71f9da6 could not be found. Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f97a3d13-b927-4f81-9df8-ebd55efeb6f1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Request method failure captured: Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 HTTP/1.1 Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgsqE3Xmg2AE5YLx0pkupvvtQcUxcXI09qkcOkp7dLKxk2gQoqbrfANXoNdxzH71g_REbGQZLOHNP50o1LlgBcXpTO5GfwY46oyvZl1ogM0_uZgZF6XZI4w2If01yMf8WmDbqC2qzGYYun7iE9z70Au3ay45OGSxvQflrC1jRWzVIY4 Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 2ac977e5066e413c9e9cc06b5a012fdf Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-TestShelveInstance-471105945 Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:34:57.162929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:34:57.164498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2ac977e5066e413c9e9cc06b5a012fdf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2ac977e5066e413c9e9cc06b5a012fdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2ac977e5066e413c9e9cc06b5a012fdf", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2ac977e5066e413c9e9cc06b5a012fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:34:57.164498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-TestShelveInstance-471105945 Aug 24 11:34:57.164498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 2ac977e5066e413c9e9cc06b5a012fdf Aug 24 11:34:57.164498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-TestShelveInstance-471105945 Aug 24 11:34:57.164498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-TestShelveInstance-471105945-project Aug 24 11:34:57.164498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:34:57.164498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:34:57.164498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: b1971caade1b4c34a6c69c600070bc5e Aug 24 11:34:57.164498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-TestShelveInstance-471105945-project Aug 24 11:34:57.164498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:34:57.164498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance a9b6e400-1d49-417d-9140-692da71f9da6 could not be found. Aug 24 11:34:57.164498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': 'a9b6e400-1d49-417d-9140-692da71f9da6'} Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9b6e400-1d49-417d-9140-692da71f9da6 could not be found. Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:34:57.165325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9b6e400-1d49-417d-9140-692da71f9da6 could not be found. Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9b6e400-1d49-417d-9140-692da71f9da6 could not be found. Aug 24 11:34:57.166652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:34:57.168492 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f97a3d13-b927-4f81-9df8-ebd55efeb6f1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Returning 404 to user: Instance a9b6e400-1d49-417d-9140-692da71f9da6 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:34:57.168492 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f97a3d13-b927-4f81-9df8-ebd55efeb6f1 tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6" status: 404 len: 111 microversion: 2.1 time: 0.031734 Aug 24 11:34:57.168492 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 454/920] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:34:57 2022] GET /compute/v2.1/servers/a9b6e400-1d49-417d-9140-692da71f9da6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:34:57.403160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-61a3cb43-ea00-4431-908f-7b5287a3d92d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] Calling method '.version_select at 0x7f723d833b80>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:57.497100 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-61a3cb43-ea00-4431-908f-7b5287a3d92d tempest-TestShelveInstance-471105945 tempest-TestShelveInstance-471105945-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-125789780" status: 202 len: 0 microversion: 2.1 time: 0.097783 Aug 24 11:34:57.497852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 467/921] 10.222.0.83 () {58 vars in 1251 bytes} [Wed Aug 24 11:34:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-125789780 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:34:58.673802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-5d6f6107-4f71-4bb7-a10f-986776da0060 req-b335e79e-6a60-4740-96db-441331bed522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228d2379-c4ae-4cf8-81bd-0fa2f4d418ba", "tag": "4b482463-7461-41c3-860d-731d3f9a6c27"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:34:58.687690 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5d6f6107-4f71-4bb7-a10f-986776da0060 req-b335e79e-6a60-4740-96db-441331bed522 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:58.688368 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5d6f6107-4f71-4bb7-a10f-986776da0060 req-b335e79e-6a60-4740-96db-441331bed522 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:58.688957 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5d6f6107-4f71-4bb7-a10f-986776da0060 req-b335e79e-6a60-4740-96db-441331bed522 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:58.691159 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-614c89af-9a4d-4a64-a641-08fe6841679a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:34:58.691665 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-614c89af-9a4d-4a64-a641-08fe6841679a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:34:58.699858 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-614c89af-9a4d-4a64-a641-08fe6841679a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:58.701795 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-614c89af-9a4d-4a64-a641-08fe6841679a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:58.702902 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-614c89af-9a4d-4a64-a641-08fe6841679a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:58.703794 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-614c89af-9a4d-4a64-a641-08fe6841679a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:34:58.704886 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-614c89af-9a4d-4a64-a641-08fe6841679a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:34:58.705488 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-614c89af-9a4d-4a64-a641-08fe6841679a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:34:58.706013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-5d6f6107-4f71-4bb7-a10f-986776da0060 req-b335e79e-6a60-4740-96db-441331bed522 service nova] Creating event network-changed:4b482463-7461-41c3-860d-731d3f9a6c27 for instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba on hv-cinder-85427 Aug 24 11:34:58.712942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-5d6f6107-4f71-4bb7-a10f-986776da0060 req-b335e79e-6a60-4740-96db-441331bed522 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043266 Aug 24 11:34:58.714024 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 468/922] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:34:58.732834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-614c89af-9a4d-4a64-a641-08fe6841679a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/ips" status: 200 len: 145 microversion: 2.1 time: 0.204734 Aug 24 11:34:58.733544 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 455/923] 10.222.0.83 () {58 vars in 1248 bytes} [Wed Aug 24 11:34:58 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/ips => generated 145 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:01.609240 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-378d6b79-c215-4e58-a834-3e554831aed7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ce1c70f-e5bf-4b39-acde-e050aa1b8d4c"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:01.611760 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-378d6b79-c215-4e58-a834-3e554831aed7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:01.618673 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-378d6b79-c215-4e58-a834-3e554831aed7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:01.619158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-378d6b79-c215-4e58-a834-3e554831aed7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:01.619640 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-378d6b79-c215-4e58-a834-3e554831aed7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:01.620360 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-378d6b79-c215-4e58-a834-3e554831aed7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:01.620819 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-378d6b79-c215-4e58-a834-3e554831aed7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:01.621235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-378d6b79-c215-4e58-a834-3e554831aed7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:02.294355 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:02.517846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-378d6b79-c215-4e58-a834-3e554831aed7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "POST /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.913653 Aug 24 11:35:02.524258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 469/924] 10.222.0.83 () {60 vars in 1323 bytes} [Wed Aug 24 11:35:01 2022] POST /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments => generated 194 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:11.127331 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e89ed006-f313-40ee-be64-0cfa28c7f2b7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:11.129598 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e89ed006-f313-40ee-be64-0cfa28c7f2b7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:11.132459 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:11.133114 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=12 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:11.138079 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e89ed006-f313-40ee-be64-0cfa28c7f2b7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:11.138821 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e89ed006-f313-40ee-be64-0cfa28c7f2b7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:11.139250 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e89ed006-f313-40ee-be64-0cfa28c7f2b7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:11.139941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e89ed006-f313-40ee-be64-0cfa28c7f2b7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:11.140435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e89ed006-f313-40ee-be64-0cfa28c7f2b7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:11.140854 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e89ed006-f313-40ee-be64-0cfa28c7f2b7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:11.170599 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e89ed006-f313-40ee-be64-0cfa28c7f2b7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047147 Aug 24 11:35:11.171150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 456/925] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:35:11 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:11.183905 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c9f8bf4c-869a-43be-8f1d-0cc3197c4cd9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:11.184574 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c9f8bf4c-869a-43be-8f1d-0cc3197c4cd9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:11.186998 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:11.192525 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c9f8bf4c-869a-43be-8f1d-0cc3197c4cd9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:11.193007 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c9f8bf4c-869a-43be-8f1d-0cc3197c4cd9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:11.193437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c9f8bf4c-869a-43be-8f1d-0cc3197c4cd9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:11.194691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c9f8bf4c-869a-43be-8f1d-0cc3197c4cd9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:11.195111 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c9f8bf4c-869a-43be-8f1d-0cc3197c4cd9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:11.195627 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c9f8bf4c-869a-43be-8f1d-0cc3197c4cd9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:11.227058 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c9f8bf4c-869a-43be-8f1d-0cc3197c4cd9 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments/6ce1c70f-e5bf-4b39-acde-e050aa1b8d4c" status: 200 len: 194 microversion: 2.1 time: 0.048155 Aug 24 11:35:11.227637 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 470/926] 10.222.0.83 () {58 vars in 1413 bytes} [Wed Aug 24 11:35:11 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments/6ce1c70f-e5bf-4b39-acde-e050aa1b8d4c => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:13.931601 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1cb13779-4293-4572-944f-7cef56c4e925 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "170aa9e2-1b31-4b0e-93c2-397a08dac755"}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:13.934025 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1cb13779-4293-4572-944f-7cef56c4e925 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:13.941603 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1cb13779-4293-4572-944f-7cef56c4e925 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:13.942120 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1cb13779-4293-4572-944f-7cef56c4e925 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:13.942554 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1cb13779-4293-4572-944f-7cef56c4e925 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:13.943245 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1cb13779-4293-4572-944f-7cef56c4e925 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:13.943696 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1cb13779-4293-4572-944f-7cef56c4e925 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:13.944145 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1cb13779-4293-4572-944f-7cef56c4e925 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:14.859596 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1cb13779-4293-4572-944f-7cef56c4e925 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "POST /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.931683 Aug 24 11:35:14.860223 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 457/927] 10.222.0.83 () {60 vars in 1323 bytes} [Wed Aug 24 11:35:13 2022] POST /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments => generated 194 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:35:23.456613 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-00c9394b-5293-49fe-a16c-e4df6e510834 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:23.458972 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-00c9394b-5293-49fe-a16c-e4df6e510834 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:23.467034 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00c9394b-5293-49fe-a16c-e4df6e510834 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:23.469278 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00c9394b-5293-49fe-a16c-e4df6e510834 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:23.469278 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00c9394b-5293-49fe-a16c-e4df6e510834 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:23.469278 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00c9394b-5293-49fe-a16c-e4df6e510834 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:23.469278 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00c9394b-5293-49fe-a16c-e4df6e510834 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:23.469656 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00c9394b-5293-49fe-a16c-e4df6e510834 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:23.499887 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-00c9394b-5293-49fe-a16c-e4df6e510834 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048009 Aug 24 11:35:23.500569 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 471/928] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:35:23 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:23.642109 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0c139a70-8f0d-4273-b56c-99e3e7e8138e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:23.642766 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0c139a70-8f0d-4273-b56c-99e3e7e8138e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:23.650067 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c139a70-8f0d-4273-b56c-99e3e7e8138e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:23.650551 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c139a70-8f0d-4273-b56c-99e3e7e8138e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:23.650981 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c139a70-8f0d-4273-b56c-99e3e7e8138e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:23.651690 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c139a70-8f0d-4273-b56c-99e3e7e8138e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:23.652138 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c139a70-8f0d-4273-b56c-99e3e7e8138e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:23.652554 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0c139a70-8f0d-4273-b56c-99e3e7e8138e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:23.681627 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0c139a70-8f0d-4273-b56c-99e3e7e8138e tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments/6ce1c70f-e5bf-4b39-acde-e050aa1b8d4c" status: 200 len: 194 microversion: 2.1 time: 0.043996 Aug 24 11:35:23.682146 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 458/929] 10.222.0.83 () {58 vars in 1413 bytes} [Wed Aug 24 11:35:23 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments/6ce1c70f-e5bf-4b39-acde-e050aa1b8d4c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:23.692471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4cb28b44-2a71-47e6-8afa-974a27626b28 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:23.692972 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4cb28b44-2a71-47e6-8afa-974a27626b28 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:23.700124 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cb28b44-2a71-47e6-8afa-974a27626b28 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:23.700614 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cb28b44-2a71-47e6-8afa-974a27626b28 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:23.701062 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cb28b44-2a71-47e6-8afa-974a27626b28 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:23.701750 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cb28b44-2a71-47e6-8afa-974a27626b28 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:23.702242 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cb28b44-2a71-47e6-8afa-974a27626b28 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:23.702662 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4cb28b44-2a71-47e6-8afa-974a27626b28 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:23.783786 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-4cb28b44-2a71-47e6-8afa-974a27626b28 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lazy-loading 'services' on Instance uuid f96acf95-d040-4dac-be10-83ebe5aae8c3 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:35:23.990131 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4cb28b44-2a71-47e6-8afa-974a27626b28 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments/6ce1c70f-e5bf-4b39-acde-e050aa1b8d4c" status: 202 len: 0 microversion: 2.1 time: 0.301192 Aug 24 11:35:23.990914 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 472/930] 10.222.0.83 () {58 vars in 1416 bytes} [Wed Aug 24 11:35:23 2022] DELETE /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments/6ce1c70f-e5bf-4b39-acde-e050aa1b8d4c => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:35:26.167521 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3e6b7104-33f6-4e04-8730-d68915bf547a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:26.168027 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3e6b7104-33f6-4e04-8730-d68915bf547a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:26.174663 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3e6b7104-33f6-4e04-8730-d68915bf547a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:26.175141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3e6b7104-33f6-4e04-8730-d68915bf547a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:26.175571 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3e6b7104-33f6-4e04-8730-d68915bf547a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:26.176252 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3e6b7104-33f6-4e04-8730-d68915bf547a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:26.176699 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3e6b7104-33f6-4e04-8730-d68915bf547a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:26.177120 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3e6b7104-33f6-4e04-8730-d68915bf547a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:26.206549 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3e6b7104-33f6-4e04-8730-d68915bf547a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments/170aa9e2-1b31-4b0e-93c2-397a08dac755" status: 200 len: 194 microversion: 2.1 time: 0.042922 Aug 24 11:35:26.207128 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 459/931] 10.222.0.83 () {58 vars in 1413 bytes} [Wed Aug 24 11:35:26 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments/170aa9e2-1b31-4b0e-93c2-397a08dac755 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:26.218938 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-088e05d4-ce9c-4639-a340-48ed055006d1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:26.228680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-088e05d4-ce9c-4639-a340-48ed055006d1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:26.228680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-088e05d4-ce9c-4639-a340-48ed055006d1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:26.228680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-088e05d4-ce9c-4639-a340-48ed055006d1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:26.228680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-088e05d4-ce9c-4639-a340-48ed055006d1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:26.229107 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-088e05d4-ce9c-4639-a340-48ed055006d1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:26.229107 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-088e05d4-ce9c-4639-a340-48ed055006d1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:26.229286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-088e05d4-ce9c-4639-a340-48ed055006d1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:26.313462 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-088e05d4-ce9c-4639-a340-48ed055006d1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lazy-loading 'services' on Instance uuid f96acf95-d040-4dac-be10-83ebe5aae8c3 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:35:26.585859 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-088e05d4-ce9c-4639-a340-48ed055006d1 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments/170aa9e2-1b31-4b0e-93c2-397a08dac755" status: 202 len: 0 microversion: 2.1 time: 0.371279 Aug 24 11:35:26.587043 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 473/932] 10.222.0.83 () {58 vars in 1416 bytes} [Wed Aug 24 11:35:26 2022] DELETE /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments/170aa9e2-1b31-4b0e-93c2-397a08dac755 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:35:28.812516 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e7fe0e53-e886-4b30-bce1-040c5dedcadb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:28.814745 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e7fe0e53-e886-4b30-bce1-040c5dedcadb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:28.821148 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e7fe0e53-e886-4b30-bce1-040c5dedcadb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:28.821647 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e7fe0e53-e886-4b30-bce1-040c5dedcadb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:28.822124 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e7fe0e53-e886-4b30-bce1-040c5dedcadb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:28.822823 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e7fe0e53-e886-4b30-bce1-040c5dedcadb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:28.823279 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e7fe0e53-e886-4b30-bce1-040c5dedcadb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:28.823702 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e7fe0e53-e886-4b30-bce1-040c5dedcadb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:28.852303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e7fe0e53-e886-4b30-bce1-040c5dedcadb tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043747 Aug 24 11:35:28.852856 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 460/933] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:35:28 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:35:28.970377 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2c3baf68-a193-483f-845e-27c1e951574a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:28.972794 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2c3baf68-a193-483f-845e-27c1e951574a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:28.979815 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c3baf68-a193-483f-845e-27c1e951574a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:28.980301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c3baf68-a193-483f-845e-27c1e951574a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:28.980741 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c3baf68-a193-483f-845e-27c1e951574a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:28.981424 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c3baf68-a193-483f-845e-27c1e951574a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:28.981911 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c3baf68-a193-483f-845e-27c1e951574a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:28.982325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c3baf68-a193-483f-845e-27c1e951574a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:29.013170 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2c3baf68-a193-483f-845e-27c1e951574a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047384 Aug 24 11:35:29.014116 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 474/934] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:35:28 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:35:29.077124 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e3d57144-1745-48d4-8353-31ce7cf6617a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:29.077621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e3d57144-1745-48d4-8353-31ce7cf6617a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:29.083729 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e3d57144-1745-48d4-8353-31ce7cf6617a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:29.084217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e3d57144-1745-48d4-8353-31ce7cf6617a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:29.084655 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e3d57144-1745-48d4-8353-31ce7cf6617a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:29.085444 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e3d57144-1745-48d4-8353-31ce7cf6617a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:29.086345 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e3d57144-1745-48d4-8353-31ce7cf6617a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:29.086774 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e3d57144-1745-48d4-8353-31ce7cf6617a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:29.113198 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e3d57144-1745-48d4-8353-31ce7cf6617a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Going to try to terminate instance {{(pid=121222) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:35:29.411390 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e3d57144-1745-48d4-8353-31ce7cf6617a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 204 len: 0 microversion: 2.1 time: 0.337280 Aug 24 11:35:29.412589 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 461/935] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:35:29 2022] DELETE /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:35:29.421283 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e16e49fa-c4b5-44ff-9efa-b533a4791f77 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:29.422048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e16e49fa-c4b5-44ff-9efa-b533a4791f77 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:29.428657 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e16e49fa-c4b5-44ff-9efa-b533a4791f77 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:29.429150 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e16e49fa-c4b5-44ff-9efa-b533a4791f77 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:29.429705 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e16e49fa-c4b5-44ff-9efa-b533a4791f77 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:29.430434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e16e49fa-c4b5-44ff-9efa-b533a4791f77 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:29.430930 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e16e49fa-c4b5-44ff-9efa-b533a4791f77 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:29.431347 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e16e49fa-c4b5-44ff-9efa-b533a4791f77 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:29.561896 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e16e49fa-c4b5-44ff-9efa-b533a4791f77 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:29.569667 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e16e49fa-c4b5-44ff-9efa-b533a4791f77 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1672 microversion: 2.1 time: 0.152663 Aug 24 11:35:29.570891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 475/936] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:29 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:30.435465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b816a3ad-2cb9-4274-9f78-7845d106a882 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:30.436113 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b816a3ad-2cb9-4274-9f78-7845d106a882 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:30.442611 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b816a3ad-2cb9-4274-9f78-7845d106a882 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:30.443095 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b816a3ad-2cb9-4274-9f78-7845d106a882 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:30.443527 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b816a3ad-2cb9-4274-9f78-7845d106a882 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:30.444210 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b816a3ad-2cb9-4274-9f78-7845d106a882 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:30.444658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b816a3ad-2cb9-4274-9f78-7845d106a882 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:30.445078 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b816a3ad-2cb9-4274-9f78-7845d106a882 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:30.467874 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b816a3ad-2cb9-4274-9f78-7845d106a882 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/ips" status: 200 len: 152 microversion: 2.20 time: 0.036728 Aug 24 11:35:30.468443 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 462/937] 10.222.0.83 () {60 vars in 1289 bytes} [Wed Aug 24 11:35:30 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:35:30.591607 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7c65c362-00c4-4dd9-acef-862da772e640 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:30.592151 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7c65c362-00c4-4dd9-acef-862da772e640 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:30.598428 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7c65c362-00c4-4dd9-acef-862da772e640 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:30.598926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7c65c362-00c4-4dd9-acef-862da772e640 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:30.599354 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7c65c362-00c4-4dd9-acef-862da772e640 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:30.600043 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7c65c362-00c4-4dd9-acef-862da772e640 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:30.600497 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7c65c362-00c4-4dd9-acef-862da772e640 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:30.600929 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7c65c362-00c4-4dd9-acef-862da772e640 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:30.733200 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7c65c362-00c4-4dd9-acef-862da772e640 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:30.741174 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7c65c362-00c4-4dd9-acef-862da772e640 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1672 microversion: 2.1 time: 0.153470 Aug 24 11:35:30.741779 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 476/938] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:30 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:31.763346 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-56bef7d7-6206-430c-a14a-7d0e4d36fe89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:31.763873 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-56bef7d7-6206-430c-a14a-7d0e4d36fe89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:31.770570 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-56bef7d7-6206-430c-a14a-7d0e4d36fe89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:31.771056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-56bef7d7-6206-430c-a14a-7d0e4d36fe89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:31.771492 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-56bef7d7-6206-430c-a14a-7d0e4d36fe89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:31.772184 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-56bef7d7-6206-430c-a14a-7d0e4d36fe89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:31.772645 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-56bef7d7-6206-430c-a14a-7d0e4d36fe89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:31.773692 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-56bef7d7-6206-430c-a14a-7d0e4d36fe89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:31.906397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-56bef7d7-6206-430c-a14a-7d0e4d36fe89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:31.914263 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-56bef7d7-6206-430c-a14a-7d0e4d36fe89 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1672 microversion: 2.1 time: 0.155092 Aug 24 11:35:31.914823 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 463/939] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:31 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:32.935316 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e3428fc8-9176-42a5-a96f-a0faa26107ca tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:32.935946 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e3428fc8-9176-42a5-a96f-a0faa26107ca tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:32.942551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e3428fc8-9176-42a5-a96f-a0faa26107ca tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:32.943052 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e3428fc8-9176-42a5-a96f-a0faa26107ca tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:32.943501 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e3428fc8-9176-42a5-a96f-a0faa26107ca tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:32.944219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e3428fc8-9176-42a5-a96f-a0faa26107ca tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:32.944705 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e3428fc8-9176-42a5-a96f-a0faa26107ca tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:32.945101 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e3428fc8-9176-42a5-a96f-a0faa26107ca tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:33.011607 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e3428fc8-9176-42a5-a96f-a0faa26107ca tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:33.020149 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e3428fc8-9176-42a5-a96f-a0faa26107ca tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1604 microversion: 2.1 time: 0.088592 Aug 24 11:35:33.020744 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 477/940] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:32 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1604 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:33.322930 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-075baee0-7afb-43da-b16d-af94f22d522a req-e71fed6a-b4a5-4052-98d4-d1a67bc45ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96acf95-d040-4dac-be10-83ebe5aae8c3", "name": "network-vif-deleted", "tag": "9e9b0093-ea8c-4e85-a039-f9a817c23761"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:33.333442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-075baee0-7afb-43da-b16d-af94f22d522a req-e71fed6a-b4a5-4052-98d4-d1a67bc45ba9 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:33.333942 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-075baee0-7afb-43da-b16d-af94f22d522a req-e71fed6a-b4a5-4052-98d4-d1a67bc45ba9 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:33.334366 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-075baee0-7afb-43da-b16d-af94f22d522a req-e71fed6a-b4a5-4052-98d4-d1a67bc45ba9 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:33.346932 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-075baee0-7afb-43da-b16d-af94f22d522a req-e71fed6a-b4a5-4052-98d4-d1a67bc45ba9 service nova] Creating event network-vif-deleted:9e9b0093-ea8c-4e85-a039-f9a817c23761 for instance f96acf95-d040-4dac-be10-83ebe5aae8c3 on hv-cinder-85427 Aug 24 11:35:33.351339 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-075baee0-7afb-43da-b16d-af94f22d522a req-e71fed6a-b4a5-4052-98d4-d1a67bc45ba9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032048 Aug 24 11:35:33.352559 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 464/941] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:35:34.043372 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b36c5d1a-bd62-4f3f-ae77-ae081b967d25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:34.043974 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b36c5d1a-bd62-4f3f-ae77-ae081b967d25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:34.050630 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b36c5d1a-bd62-4f3f-ae77-ae081b967d25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:34.051110 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b36c5d1a-bd62-4f3f-ae77-ae081b967d25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:34.051541 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b36c5d1a-bd62-4f3f-ae77-ae081b967d25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:34.052404 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b36c5d1a-bd62-4f3f-ae77-ae081b967d25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:34.052854 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b36c5d1a-bd62-4f3f-ae77-ae081b967d25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:34.053274 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b36c5d1a-bd62-4f3f-ae77-ae081b967d25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:34.085837 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b36c5d1a-bd62-4f3f-ae77-ae081b967d25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:34.086390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b36c5d1a-bd62-4f3f-ae77-ae081b967d25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:34.086831 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b36c5d1a-bd62-4f3f-ae77-ae081b967d25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:34.087267 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-b36c5d1a-bd62-4f3f-ae77-ae081b967d25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lazy-loading 'fault' on Instance uuid f96acf95-d040-4dac-be10-83ebe5aae8c3 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:35:34.138613 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b36c5d1a-bd62-4f3f-ae77-ae081b967d25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd79bc9c3a694fe2a4e3c645e682e438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e8de8aeabf4b8fa67ed0784fc39e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:34.143454 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b36c5d1a-bd62-4f3f-ae77-ae081b967d25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 200 len: 1326 microversion: 2.1 time: 0.104619 Aug 24 11:35:34.144025 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 478/942] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:34 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:35:34.307311 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5ac905ed-fccf-4273-9a13-eedfb14dcb19 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:34.307962 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5ac905ed-fccf-4273-9a13-eedfb14dcb19 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:34.314178 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5ac905ed-fccf-4273-9a13-eedfb14dcb19 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:34.314654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5ac905ed-fccf-4273-9a13-eedfb14dcb19 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:34.315084 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5ac905ed-fccf-4273-9a13-eedfb14dcb19 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:34.315795 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5ac905ed-fccf-4273-9a13-eedfb14dcb19 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:34.316241 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5ac905ed-fccf-4273-9a13-eedfb14dcb19 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:34.316651 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5ac905ed-fccf-4273-9a13-eedfb14dcb19 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:34.339831 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-5ac905ed-fccf-4273-9a13-eedfb14dcb19 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lazy-loading 'flavor' on Instance uuid 17c6a206-49d7-44b6-a24f-f5961f099597 {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:35:35.058241 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5ac905ed-fccf-4273-9a13-eedfb14dcb19 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "POST /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/action" status: 202 len: 0 microversion: 2.20 time: 0.755197 Aug 24 11:35:35.058867 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 465/943] 10.222.0.83 () {62 vars in 1319 bytes} [Wed Aug 24 11:35:34 2022] POST /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:35:35.067765 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-248d2db3-2d55-404d-9ca0-53724b95975c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:35.068583 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-248d2db3-2d55-404d-9ca0-53724b95975c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:35.075443 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-248d2db3-2d55-404d-9ca0-53724b95975c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:35.078046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-248d2db3-2d55-404d-9ca0-53724b95975c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:35.078046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-248d2db3-2d55-404d-9ca0-53724b95975c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:35.078046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-248d2db3-2d55-404d-9ca0-53724b95975c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:35.078046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-248d2db3-2d55-404d-9ca0-53724b95975c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:35.078505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-248d2db3-2d55-404d-9ca0-53724b95975c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:35.167708 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b3dc60df-d937-49c6-9103-c3f336f28346 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:35.168571 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b3dc60df-d937-49c6-9103-c3f336f28346 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:35.179601 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b3dc60df-d937-49c6-9103-c3f336f28346 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:35.180978 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b3dc60df-d937-49c6-9103-c3f336f28346 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:35.181982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b3dc60df-d937-49c6-9103-c3f336f28346 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:35.183193 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b3dc60df-d937-49c6-9103-c3f336f28346 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:35.184006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b3dc60df-d937-49c6-9103-c3f336f28346 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:35.184731 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b3dc60df-d937-49c6-9103-c3f336f28346 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:35.206961 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-b3dc60df-d937-49c6-9103-c3f336f28346 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] HTTP exception thrown: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b3dc60df-d937-49c6-9103-c3f336f28346 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Request method failure captured: Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 HTTP/1.1 Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgqCpaDBmROQ-4pnxpGvdDtMs0hYSPuU23mEUbVDYXQps29rzX_SygxCabzffIt8IdqHi8SpQMSv-yudceTB_oD56vBU20my7XIo7M-kmCKt5en23FlZly1PPX8g6AuBIHHJpfLdhZexIWSaFQ83zoAnbfpXXsze7ogC-k7NMXjFkSA Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 86e8de8aeabf4b8fa67ed0784fc39e46 Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:35:35.208621 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:35:35.210483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_86e8de8aeabf4b8fa67ed0784fc39e46", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:35:35.210483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:35.210483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 86e8de8aeabf4b8fa67ed0784fc39e46 Aug 24 11:35:35.210483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:35.210483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-AttachVolumeTestJSON-104879377-project Aug 24 11:35:35.210483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:35:35.210483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:35:35.210483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: cd79bc9c3a694fe2a4e3c645e682e438 Aug 24 11:35:35.210483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-AttachVolumeTestJSON-104879377-project Aug 24 11:35:35.210483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:35:35.210483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:35.210483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': 'f96acf95-d040-4dac-be10-83ebe5aae8c3'} Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:35:35.211412 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:35.212997 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:35.214379 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b3dc60df-d937-49c6-9103-c3f336f28346 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Returning 404 to user: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:35:35.214379 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b3dc60df-d937-49c6-9103-c3f336f28346 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 404 len: 111 microversion: 2.1 time: 0.047972 Aug 24 11:35:35.214379 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 466/944] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:35 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:35:35.220534 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-bb1c4aea-16a8-429e-875c-bcbbc447306a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '.version_select at 0x7f723d0a45e0>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:35.228380 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-248d2db3-2d55-404d-9ca0-53724b95975c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:35.237359 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-248d2db3-2d55-404d-9ca0-53724b95975c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:35.238885 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-248d2db3-2d55-404d-9ca0-53724b95975c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:35.240052 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-248d2db3-2d55-404d-9ca0-53724b95975c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1724 microversion: 2.20 time: 0.176514 Aug 24 11:35:35.240642 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 479/945] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:35 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:35.327743 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-bb1c4aea-16a8-429e-875c-bcbbc447306a tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-196176851" status: 202 len: 0 microversion: 2.1 time: 0.110840 Aug 24 11:35:35.327743 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 467/946] 10.222.0.83 () {58 vars in 1218 bytes} [Wed Aug 24 11:35:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-196176851 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 11:35:36.264967 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ffc6c6ad-c02b-4397-aa0d-73b06aa7f6e9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:36.265638 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ffc6c6ad-c02b-4397-aa0d-73b06aa7f6e9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:36.272030 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ffc6c6ad-c02b-4397-aa0d-73b06aa7f6e9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:36.272513 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ffc6c6ad-c02b-4397-aa0d-73b06aa7f6e9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:36.272948 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ffc6c6ad-c02b-4397-aa0d-73b06aa7f6e9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:36.274396 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ffc6c6ad-c02b-4397-aa0d-73b06aa7f6e9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:36.274855 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ffc6c6ad-c02b-4397-aa0d-73b06aa7f6e9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:36.275278 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ffc6c6ad-c02b-4397-aa0d-73b06aa7f6e9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:36.409499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ffc6c6ad-c02b-4397-aa0d-73b06aa7f6e9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:36.418867 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ffc6c6ad-c02b-4397-aa0d-73b06aa7f6e9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:36.420555 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ffc6c6ad-c02b-4397-aa0d-73b06aa7f6e9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:36.421826 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ffc6c6ad-c02b-4397-aa0d-73b06aa7f6e9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1724 microversion: 2.20 time: 0.161514 Aug 24 11:35:36.422641 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 480/947] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:36 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:37.445681 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b2b37081-ee2c-4612-ac7a-a1943b79895f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:37.446309 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b2b37081-ee2c-4612-ac7a-a1943b79895f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:37.453220 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b2b37081-ee2c-4612-ac7a-a1943b79895f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:37.453707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b2b37081-ee2c-4612-ac7a-a1943b79895f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:37.454181 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b2b37081-ee2c-4612-ac7a-a1943b79895f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:37.454875 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b2b37081-ee2c-4612-ac7a-a1943b79895f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:37.455341 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b2b37081-ee2c-4612-ac7a-a1943b79895f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:37.455763 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b2b37081-ee2c-4612-ac7a-a1943b79895f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:37.589716 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b2b37081-ee2c-4612-ac7a-a1943b79895f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:37.598064 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b2b37081-ee2c-4612-ac7a-a1943b79895f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:37.599577 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b2b37081-ee2c-4612-ac7a-a1943b79895f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:37.600747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b2b37081-ee2c-4612-ac7a-a1943b79895f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1724 microversion: 2.20 time: 0.159605 Aug 24 11:35:37.601304 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 468/948] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:37 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:38.624572 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f3b31aa3-713d-46c1-8aa4-7efc4ae0b558 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:38.625227 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f3b31aa3-713d-46c1-8aa4-7efc4ae0b558 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:38.632842 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f3b31aa3-713d-46c1-8aa4-7efc4ae0b558 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:38.634990 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f3b31aa3-713d-46c1-8aa4-7efc4ae0b558 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:38.634990 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f3b31aa3-713d-46c1-8aa4-7efc4ae0b558 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:38.634990 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f3b31aa3-713d-46c1-8aa4-7efc4ae0b558 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:38.635509 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f3b31aa3-713d-46c1-8aa4-7efc4ae0b558 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:38.635734 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f3b31aa3-713d-46c1-8aa4-7efc4ae0b558 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:38.763899 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f3b31aa3-713d-46c1-8aa4-7efc4ae0b558 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:38.772057 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f3b31aa3-713d-46c1-8aa4-7efc4ae0b558 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:38.774014 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f3b31aa3-713d-46c1-8aa4-7efc4ae0b558 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:38.775154 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f3b31aa3-713d-46c1-8aa4-7efc4ae0b558 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1724 microversion: 2.20 time: 0.154583 Aug 24 11:35:38.775706 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 481/949] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:38 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:38.819310 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-90ca6450-e707-4520-8fe9-bc0a8a5907c7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:38.819854 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-90ca6450-e707-4520-8fe9-bc0a8a5907c7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:38.826409 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-90ca6450-e707-4520-8fe9-bc0a8a5907c7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:38.826889 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-90ca6450-e707-4520-8fe9-bc0a8a5907c7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:38.827406 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-90ca6450-e707-4520-8fe9-bc0a8a5907c7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:38.828153 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-90ca6450-e707-4520-8fe9-bc0a8a5907c7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:38.828532 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-90ca6450-e707-4520-8fe9-bc0a8a5907c7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:38.829032 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-90ca6450-e707-4520-8fe9-bc0a8a5907c7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:38.842840 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-90ca6450-e707-4520-8fe9-bc0a8a5907c7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] HTTP exception thrown: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-90ca6450-e707-4520-8fe9-bc0a8a5907c7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Request method failure captured: Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: DELETE /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 HTTP/1.1 Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgqCpaDBmROQ-4pnxpGvdDtMs0hYSPuU23mEUbVDYXQps29rzX_SygxCabzffIt8IdqHi8SpQMSv-yudceTB_oD56vBU20my7XIo7M-kmCKt5en23FlZly1PPX8g6AuBIHHJpfLdhZexIWSaFQ83zoAnbfpXXsze7ogC-k7NMXjFkSA Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 86e8de8aeabf4b8fa67ed0784fc39e46 Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:35:38.844435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:35:38.846014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_86e8de8aeabf4b8fa67ed0784fc39e46", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:35:38.846014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:38.846014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 86e8de8aeabf4b8fa67ed0784fc39e46 Aug 24 11:35:38.846014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:38.846014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-AttachVolumeTestJSON-104879377-project Aug 24 11:35:38.846014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:35:38.846014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:35:38.846014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: cd79bc9c3a694fe2a4e3c645e682e438 Aug 24 11:35:38.846014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-AttachVolumeTestJSON-104879377-project Aug 24 11:35:38.846014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:35:38.846014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:38.846014 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': 'f96acf95-d040-4dac-be10-83ebe5aae8c3'} Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:35:38.847056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:38.848515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:38.850098 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-90ca6450-e707-4520-8fe9-bc0a8a5907c7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Returning 404 to user: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:35:38.850098 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-90ca6450-e707-4520-8fe9-bc0a8a5907c7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 404 len: 111 microversion: 2.1 time: 0.030369 Aug 24 11:35:38.850098 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 469/950] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:35:38 2022] DELETE /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:35:38.854818 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-481b6523-6cb4-46ab-a90e-b854f8dc6bf7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:38.855488 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-481b6523-6cb4-46ab-a90e-b854f8dc6bf7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: f96acf95-d040-4dac-be10-83ebe5aae8c3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:38.861392 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-481b6523-6cb4-46ab-a90e-b854f8dc6bf7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:38.861885 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-481b6523-6cb4-46ab-a90e-b854f8dc6bf7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:38.862327 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-481b6523-6cb4-46ab-a90e-b854f8dc6bf7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:38.863033 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-481b6523-6cb4-46ab-a90e-b854f8dc6bf7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:38.863477 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-481b6523-6cb4-46ab-a90e-b854f8dc6bf7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:38.863888 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-481b6523-6cb4-46ab-a90e-b854f8dc6bf7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:38.877596 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-481b6523-6cb4-46ab-a90e-b854f8dc6bf7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] HTTP exception thrown: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-481b6523-6cb4-46ab-a90e-b854f8dc6bf7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Request method failure captured: Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 HTTP/1.1 Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgqCpaDBmROQ-4pnxpGvdDtMs0hYSPuU23mEUbVDYXQps29rzX_SygxCabzffIt8IdqHi8SpQMSv-yudceTB_oD56vBU20my7XIo7M-kmCKt5en23FlZly1PPX8g6AuBIHHJpfLdhZexIWSaFQ83zoAnbfpXXsze7ogC-k7NMXjFkSA Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 86e8de8aeabf4b8fa67ed0784fc39e46 Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:35:38.879315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:35:38.881042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_86e8de8aeabf4b8fa67ed0784fc39e46", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:35:38.881042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:38.881042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 86e8de8aeabf4b8fa67ed0784fc39e46 Aug 24 11:35:38.881042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:38.881042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeTestJSON-104879377-project Aug 24 11:35:38.881042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:35:38.881042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:35:38.881042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: cd79bc9c3a694fe2a4e3c645e682e438 Aug 24 11:35:38.881042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeTestJSON-104879377-project Aug 24 11:35:38.881042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:35:38.881042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:38.881042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': 'f96acf95-d040-4dac-be10-83ebe5aae8c3'} Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:35:38.882103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. Aug 24 11:35:38.883674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:35:38.885145 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-481b6523-6cb4-46ab-a90e-b854f8dc6bf7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Returning 404 to user: Instance f96acf95-d040-4dac-be10-83ebe5aae8c3 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:35:38.885145 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-481b6523-6cb4-46ab-a90e-b854f8dc6bf7 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3" status: 404 len: 111 microversion: 2.1 time: 0.030321 Aug 24 11:35:38.885145 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 482/951] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:38 2022] GET /compute/v2.1/servers/f96acf95-d040-4dac-be10-83ebe5aae8c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:35:39.798201 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d71f9b90-194d-4ca3-8ba0-7927b30c0f79 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:39.798820 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d71f9b90-194d-4ca3-8ba0-7927b30c0f79 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:39.805371 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d71f9b90-194d-4ca3-8ba0-7927b30c0f79 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:39.805906 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d71f9b90-194d-4ca3-8ba0-7927b30c0f79 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:39.806348 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d71f9b90-194d-4ca3-8ba0-7927b30c0f79 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:39.807044 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d71f9b90-194d-4ca3-8ba0-7927b30c0f79 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:39.807503 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d71f9b90-194d-4ca3-8ba0-7927b30c0f79 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:39.807931 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d71f9b90-194d-4ca3-8ba0-7927b30c0f79 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:39.942765 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d71f9b90-194d-4ca3-8ba0-7927b30c0f79 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:39.946215 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:39.951434 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d71f9b90-194d-4ca3-8ba0-7927b30c0f79 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:39.952943 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d71f9b90-194d-4ca3-8ba0-7927b30c0f79 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:39.954161 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d71f9b90-194d-4ca3-8ba0-7927b30c0f79 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1724 microversion: 2.20 time: 0.160032 Aug 24 11:35:39.954715 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 470/952] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:39 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:40.307940 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d06331b9-c382-44ce-b8b9-f9447a5bdf25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:40.308465 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d06331b9-c382-44ce-b8b9-f9447a5bdf25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:40.314832 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d06331b9-c382-44ce-b8b9-f9447a5bdf25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:40.315304 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d06331b9-c382-44ce-b8b9-f9447a5bdf25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:40.315735 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d06331b9-c382-44ce-b8b9-f9447a5bdf25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:40.316410 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d06331b9-c382-44ce-b8b9-f9447a5bdf25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:40.316857 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d06331b9-c382-44ce-b8b9-f9447a5bdf25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:40.317270 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d06331b9-c382-44ce-b8b9-f9447a5bdf25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:40.330849 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-d06331b9-c382-44ce-b8b9-f9447a5bdf25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] HTTP exception thrown: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d06331b9-c382-44ce-b8b9-f9447a5bdf25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Request method failure captured: Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 HTTP/1.1 Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgqCpaDBmROQ-4pnxpGvdDtMs0hYSPuU23mEUbVDYXQps29rzX_SygxCabzffIt8IdqHi8SpQMSv-yudceTB_oD56vBU20my7XIo7M-kmCKt5en23FlZly1PPX8g6AuBIHHJpfLdhZexIWSaFQ83zoAnbfpXXsze7ogC-k7NMXjFkSA Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 86e8de8aeabf4b8fa67ed0784fc39e46 Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:35:40.332432 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:35:40.334140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_86e8de8aeabf4b8fa67ed0784fc39e46", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:35:40.334140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:40.334140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 86e8de8aeabf4b8fa67ed0784fc39e46 Aug 24 11:35:40.334140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:40.334140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeTestJSON-104879377-project Aug 24 11:35:40.334140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:35:40.334140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:35:40.334140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: cd79bc9c3a694fe2a4e3c645e682e438 Aug 24 11:35:40.334140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeTestJSON-104879377-project Aug 24 11:35:40.334140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:35:40.334140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:35:40.334140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': 'b611366f-7de9-4b85-8464-8a9b8aaed0c5'} Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:35:40.335251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:35:40.337301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:35:40.338986 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d06331b9-c382-44ce-b8b9-f9447a5bdf25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Returning 404 to user: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:35:40.338986 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d06331b9-c382-44ce-b8b9-f9447a5bdf25 tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 404 len: 111 microversion: 2.1 time: 0.029709 Aug 24 11:35:40.338986 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 483/953] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:35:40 2022] DELETE /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:35:40.342760 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-36919487-98ec-4b56-bdf7-d3b0717c209b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:40.343365 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-36919487-98ec-4b56-bdf7-d3b0717c209b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] [instance: b611366f-7de9-4b85-8464-8a9b8aaed0c5] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:40.350070 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36919487-98ec-4b56-bdf7-d3b0717c209b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:40.350548 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36919487-98ec-4b56-bdf7-d3b0717c209b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:40.350976 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36919487-98ec-4b56-bdf7-d3b0717c209b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:40.352381 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36919487-98ec-4b56-bdf7-d3b0717c209b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:40.352797 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36919487-98ec-4b56-bdf7-d3b0717c209b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:40.353272 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-36919487-98ec-4b56-bdf7-d3b0717c209b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:40.366313 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-36919487-98ec-4b56-bdf7-d3b0717c209b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] HTTP exception thrown: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-36919487-98ec-4b56-bdf7-d3b0717c209b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Request method failure captured: Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 HTTP/1.1 Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgqCpaDBmROQ-4pnxpGvdDtMs0hYSPuU23mEUbVDYXQps29rzX_SygxCabzffIt8IdqHi8SpQMSv-yudceTB_oD56vBU20my7XIo7M-kmCKt5en23FlZly1PPX8g6AuBIHHJpfLdhZexIWSaFQ83zoAnbfpXXsze7ogC-k7NMXjFkSA Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 86e8de8aeabf4b8fa67ed0784fc39e46 Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:35:40.367850 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:35:40.369436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_86e8de8aeabf4b8fa67ed0784fc39e46", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/86e8de8aeabf4b8fa67ed0784fc39e46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:35:40.369436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:40.369436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 86e8de8aeabf4b8fa67ed0784fc39e46 Aug 24 11:35:40.369436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104879377 Aug 24 11:35:40.369436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-AttachVolumeTestJSON-104879377-project Aug 24 11:35:40.369436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:35:40.369436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:35:40.369436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: cd79bc9c3a694fe2a4e3c645e682e438 Aug 24 11:35:40.369436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-AttachVolumeTestJSON-104879377-project Aug 24 11:35:40.369436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:35:40.369436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:35:40.369436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': 'b611366f-7de9-4b85-8464-8a9b8aaed0c5'} Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:35:40.370558 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. Aug 24 11:35:40.372043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:35:40.373489 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-36919487-98ec-4b56-bdf7-d3b0717c209b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] Returning 404 to user: Instance b611366f-7de9-4b85-8464-8a9b8aaed0c5 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:35:40.373489 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-36919487-98ec-4b56-bdf7-d3b0717c209b tempest-AttachVolumeTestJSON-104879377 tempest-AttachVolumeTestJSON-104879377-project] 10.222.0.83 "GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5" status: 404 len: 111 microversion: 2.1 time: 0.030281 Aug 24 11:35:40.373489 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 471/954] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:35:40 2022] GET /compute/v2.1/servers/b611366f-7de9-4b85-8464-8a9b8aaed0c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:35:40.976667 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d4dbee32-78d3-426a-bd1a-4fe452605ceb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:40.977286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d4dbee32-78d3-426a-bd1a-4fe452605ceb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:40.983468 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d4dbee32-78d3-426a-bd1a-4fe452605ceb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:40.984061 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d4dbee32-78d3-426a-bd1a-4fe452605ceb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:40.984507 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d4dbee32-78d3-426a-bd1a-4fe452605ceb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:40.985212 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d4dbee32-78d3-426a-bd1a-4fe452605ceb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:40.985666 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d4dbee32-78d3-426a-bd1a-4fe452605ceb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:40.986119 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d4dbee32-78d3-426a-bd1a-4fe452605ceb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:41.122709 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d4dbee32-78d3-426a-bd1a-4fe452605ceb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:41.131269 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d4dbee32-78d3-426a-bd1a-4fe452605ceb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:41.134867 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d4dbee32-78d3-426a-bd1a-4fe452605ceb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:41.134867 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d4dbee32-78d3-426a-bd1a-4fe452605ceb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1724 microversion: 2.20 time: 0.161860 Aug 24 11:35:41.141955 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 484/955] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:40 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:42.164299 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-60dae56e-16b5-44a5-93de-975edb1a367b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:42.164857 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-60dae56e-16b5-44a5-93de-975edb1a367b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:42.172244 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-60dae56e-16b5-44a5-93de-975edb1a367b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:42.172993 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-60dae56e-16b5-44a5-93de-975edb1a367b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:42.173608 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-60dae56e-16b5-44a5-93de-975edb1a367b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:42.174332 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-60dae56e-16b5-44a5-93de-975edb1a367b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:42.174881 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-60dae56e-16b5-44a5-93de-975edb1a367b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:42.175270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-60dae56e-16b5-44a5-93de-975edb1a367b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:42.317566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-60dae56e-16b5-44a5-93de-975edb1a367b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:42.334824 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-60dae56e-16b5-44a5-93de-975edb1a367b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:42.338867 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-60dae56e-16b5-44a5-93de-975edb1a367b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:42.338867 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-60dae56e-16b5-44a5-93de-975edb1a367b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1724 microversion: 2.20 time: 0.177760 Aug 24 11:35:42.338867 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 472/956] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:42 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:43.360863 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-851f65c5-6c4e-4b95-98eb-a381ea4ec6df tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:43.362206 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-851f65c5-6c4e-4b95-98eb-a381ea4ec6df tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:43.369444 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-851f65c5-6c4e-4b95-98eb-a381ea4ec6df tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:43.369954 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-851f65c5-6c4e-4b95-98eb-a381ea4ec6df tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:43.370388 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-851f65c5-6c4e-4b95-98eb-a381ea4ec6df tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:43.371088 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-851f65c5-6c4e-4b95-98eb-a381ea4ec6df tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:43.371563 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-851f65c5-6c4e-4b95-98eb-a381ea4ec6df tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:43.372040 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-851f65c5-6c4e-4b95-98eb-a381ea4ec6df tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:43.390820 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=96,nova_cell1:INSERT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:43.540519 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-851f65c5-6c4e-4b95-98eb-a381ea4ec6df tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:43.554681 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-851f65c5-6c4e-4b95-98eb-a381ea4ec6df tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:43.556660 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-851f65c5-6c4e-4b95-98eb-a381ea4ec6df tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:43.558108 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-851f65c5-6c4e-4b95-98eb-a381ea4ec6df tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1724 microversion: 2.20 time: 0.201334 Aug 24 11:35:43.559187 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 485/957] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:43 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:44.584265 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b4b837a6-1021-4470-a4bc-5c7c3e625433 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:44.584884 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b4b837a6-1021-4470-a4bc-5c7c3e625433 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:44.587384 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:44.592359 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b4b837a6-1021-4470-a4bc-5c7c3e625433 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:44.592853 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b4b837a6-1021-4470-a4bc-5c7c3e625433 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:44.593293 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b4b837a6-1021-4470-a4bc-5c7c3e625433 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:44.594013 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b4b837a6-1021-4470-a4bc-5c7c3e625433 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:44.594471 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b4b837a6-1021-4470-a4bc-5c7c3e625433 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:44.594897 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b4b837a6-1021-4470-a4bc-5c7c3e625433 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:44.727102 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b4b837a6-1021-4470-a4bc-5c7c3e625433 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:44.735847 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b4b837a6-1021-4470-a4bc-5c7c3e625433 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:44.739982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b4b837a6-1021-4470-a4bc-5c7c3e625433 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:44.739982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b4b837a6-1021-4470-a4bc-5c7c3e625433 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1724 microversion: 2.20 time: 0.158337 Aug 24 11:35:44.739982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 473/958] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:44 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:45.761080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9a1289c9-3ac7-40a1-ab63-6709f1f4acee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:45.761858 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9a1289c9-3ac7-40a1-ab63-6709f1f4acee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:45.768649 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9a1289c9-3ac7-40a1-ab63-6709f1f4acee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:45.769131 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9a1289c9-3ac7-40a1-ab63-6709f1f4acee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:45.769568 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9a1289c9-3ac7-40a1-ab63-6709f1f4acee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:45.770282 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9a1289c9-3ac7-40a1-ab63-6709f1f4acee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:45.770736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9a1289c9-3ac7-40a1-ab63-6709f1f4acee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:45.771156 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9a1289c9-3ac7-40a1-ab63-6709f1f4acee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:45.900770 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9a1289c9-3ac7-40a1-ab63-6709f1f4acee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:45.909466 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9a1289c9-3ac7-40a1-ab63-6709f1f4acee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:45.911021 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9a1289c9-3ac7-40a1-ab63-6709f1f4acee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:45.912220 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9a1289c9-3ac7-40a1-ab63-6709f1f4acee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1724 microversion: 2.20 time: 0.155630 Aug 24 11:35:45.912784 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 486/959] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:45 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:46.935781 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8ffdf1c8-1346-4fa4-847d-aec947687aee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:46.936327 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8ffdf1c8-1346-4fa4-847d-aec947687aee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:46.942935 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ffdf1c8-1346-4fa4-847d-aec947687aee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:46.943417 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ffdf1c8-1346-4fa4-847d-aec947687aee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:46.943847 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ffdf1c8-1346-4fa4-847d-aec947687aee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:46.944545 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ffdf1c8-1346-4fa4-847d-aec947687aee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:46.945483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ffdf1c8-1346-4fa4-847d-aec947687aee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:46.945931 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8ffdf1c8-1346-4fa4-847d-aec947687aee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:47.082814 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8ffdf1c8-1346-4fa4-847d-aec947687aee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:47.091312 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8ffdf1c8-1346-4fa4-847d-aec947687aee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:47.092804 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8ffdf1c8-1346-4fa4-847d-aec947687aee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:47.093982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8ffdf1c8-1346-4fa4-847d-aec947687aee tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1745 microversion: 2.20 time: 0.162533 Aug 24 11:35:47.094534 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 474/960] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:46 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:48.117740 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f51f040e-ca32-4040-86ed-414f68984f36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:48.118350 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f51f040e-ca32-4040-86ed-414f68984f36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:48.124817 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f51f040e-ca32-4040-86ed-414f68984f36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:48.125297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f51f040e-ca32-4040-86ed-414f68984f36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:48.125723 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f51f040e-ca32-4040-86ed-414f68984f36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:48.126448 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f51f040e-ca32-4040-86ed-414f68984f36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:48.126895 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f51f040e-ca32-4040-86ed-414f68984f36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:48.127313 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f51f040e-ca32-4040-86ed-414f68984f36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:48.265656 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f51f040e-ca32-4040-86ed-414f68984f36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:48.274137 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f51f040e-ca32-4040-86ed-414f68984f36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:48.275642 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f51f040e-ca32-4040-86ed-414f68984f36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:48.276800 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f51f040e-ca32-4040-86ed-414f68984f36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1745 microversion: 2.20 time: 0.163032 Aug 24 11:35:48.277366 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 487/961] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:48 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:49.299723 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4018311a-8c22-434c-b3e5-dbd7fc857577 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:49.300917 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4018311a-8c22-434c-b3e5-dbd7fc857577 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:49.308073 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4018311a-8c22-434c-b3e5-dbd7fc857577 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:49.308564 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4018311a-8c22-434c-b3e5-dbd7fc857577 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:49.309001 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4018311a-8c22-434c-b3e5-dbd7fc857577 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:49.309704 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4018311a-8c22-434c-b3e5-dbd7fc857577 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:49.310198 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4018311a-8c22-434c-b3e5-dbd7fc857577 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:49.310620 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4018311a-8c22-434c-b3e5-dbd7fc857577 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:49.412278 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-ec440316-395e-4c6e-9cc1-c8d597f145fc req-f943ca95-908b-402b-adb4-a9acee5ce74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c6a206-49d7-44b6-a24f-f5961f099597", "name": "network-vif-plugged", "status": "completed", "tag": "dfa0d250-97f7-4d9a-9f1c-edee2d559865"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:35:49.425890 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ec440316-395e-4c6e-9cc1-c8d597f145fc req-f943ca95-908b-402b-adb4-a9acee5ce74f service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:49.426385 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ec440316-395e-4c6e-9cc1-c8d597f145fc req-f943ca95-908b-402b-adb4-a9acee5ce74f service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:49.428956 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ec440316-395e-4c6e-9cc1-c8d597f145fc req-f943ca95-908b-402b-adb4-a9acee5ce74f service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:49.444317 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-ec440316-395e-4c6e-9cc1-c8d597f145fc req-f943ca95-908b-402b-adb4-a9acee5ce74f service nova] Creating event network-vif-plugged:dfa0d250-97f7-4d9a-9f1c-edee2d559865 for instance 17c6a206-49d7-44b6-a24f-f5961f099597 on hv-cinder-85427 Aug 24 11:35:49.451512 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-ec440316-395e-4c6e-9cc1-c8d597f145fc req-f943ca95-908b-402b-adb4-a9acee5ce74f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042097 Aug 24 11:35:49.452132 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 488/962] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:35:49.479072 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4018311a-8c22-434c-b3e5-dbd7fc857577 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:49.487721 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4018311a-8c22-434c-b3e5-dbd7fc857577 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:49.489239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4018311a-8c22-434c-b3e5-dbd7fc857577 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:49.490436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4018311a-8c22-434c-b3e5-dbd7fc857577 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1745 microversion: 2.20 time: 0.194626 Aug 24 11:35:49.490991 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 475/963] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:49 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1745 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:50.513694 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fe6108fe-7e9a-48b9-891a-b000ad8ba092 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:50.514422 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fe6108fe-7e9a-48b9-891a-b000ad8ba092 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:50.520809 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe6108fe-7e9a-48b9-891a-b000ad8ba092 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:50.521390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe6108fe-7e9a-48b9-891a-b000ad8ba092 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:50.521852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe6108fe-7e9a-48b9-891a-b000ad8ba092 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:50.522559 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe6108fe-7e9a-48b9-891a-b000ad8ba092 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:50.523034 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe6108fe-7e9a-48b9-891a-b000ad8ba092 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:50.523458 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe6108fe-7e9a-48b9-891a-b000ad8ba092 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:50.652084 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fe6108fe-7e9a-48b9-891a-b000ad8ba092 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:50.661682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fe6108fe-7e9a-48b9-891a-b000ad8ba092 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:50.663371 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fe6108fe-7e9a-48b9-891a-b000ad8ba092 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:50.665313 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fe6108fe-7e9a-48b9-891a-b000ad8ba092 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1745 microversion: 2.20 time: 0.156732 Aug 24 11:35:50.666337 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 489/964] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:50 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:51.688698 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8e7693e5-7f7c-4a49-8915-d91db52a605c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:51.689273 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8e7693e5-7f7c-4a49-8915-d91db52a605c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:51.696382 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e7693e5-7f7c-4a49-8915-d91db52a605c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:51.696854 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e7693e5-7f7c-4a49-8915-d91db52a605c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:51.697285 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e7693e5-7f7c-4a49-8915-d91db52a605c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:51.697996 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e7693e5-7f7c-4a49-8915-d91db52a605c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:51.698441 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e7693e5-7f7c-4a49-8915-d91db52a605c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:51.698858 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8e7693e5-7f7c-4a49-8915-d91db52a605c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:51.831028 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8e7693e5-7f7c-4a49-8915-d91db52a605c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:51.840686 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8e7693e5-7f7c-4a49-8915-d91db52a605c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:51.841728 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8e7693e5-7f7c-4a49-8915-d91db52a605c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:51.842945 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8e7693e5-7f7c-4a49-8915-d91db52a605c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1745 microversion: 2.20 time: 0.158294 Aug 24 11:35:51.843507 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 476/965] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:51 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:52.876471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e56e843b-8b82-465f-b04f-ff623a5784da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:52.877085 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e56e843b-8b82-465f-b04f-ff623a5784da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:52.884353 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e56e843b-8b82-465f-b04f-ff623a5784da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:52.884842 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e56e843b-8b82-465f-b04f-ff623a5784da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:52.885269 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e56e843b-8b82-465f-b04f-ff623a5784da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:52.886179 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e56e843b-8b82-465f-b04f-ff623a5784da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:52.886805 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e56e843b-8b82-465f-b04f-ff623a5784da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:52.887497 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e56e843b-8b82-465f-b04f-ff623a5784da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:53.030133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e56e843b-8b82-465f-b04f-ff623a5784da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:53.038473 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e56e843b-8b82-465f-b04f-ff623a5784da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:53.040000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e56e843b-8b82-465f-b04f-ff623a5784da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:53.041159 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e56e843b-8b82-465f-b04f-ff623a5784da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1740 microversion: 2.20 time: 0.168602 Aug 24 11:35:53.041720 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 490/966] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:52 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:54.064908 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4a034f28-b9f9-432e-8a1b-c5ff03303cf4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:54.065438 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4a034f28-b9f9-432e-8a1b-c5ff03303cf4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:54.072970 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a034f28-b9f9-432e-8a1b-c5ff03303cf4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:54.073704 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a034f28-b9f9-432e-8a1b-c5ff03303cf4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:54.074364 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a034f28-b9f9-432e-8a1b-c5ff03303cf4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:54.075245 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a034f28-b9f9-432e-8a1b-c5ff03303cf4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:54.075862 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a034f28-b9f9-432e-8a1b-c5ff03303cf4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:54.076480 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4a034f28-b9f9-432e-8a1b-c5ff03303cf4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:54.227237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4a034f28-b9f9-432e-8a1b-c5ff03303cf4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:54.242066 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4a034f28-b9f9-432e-8a1b-c5ff03303cf4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:54.244038 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4a034f28-b9f9-432e-8a1b-c5ff03303cf4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:54.245210 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4a034f28-b9f9-432e-8a1b-c5ff03303cf4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1740 microversion: 2.20 time: 0.184323 Aug 24 11:35:54.245771 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 477/967] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:54 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:55.270844 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-12a2b710-b5ba-4e53-b17b-d4322fa98ebd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:55.271489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-12a2b710-b5ba-4e53-b17b-d4322fa98ebd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:55.275298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=44 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:35:55.280339 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12a2b710-b5ba-4e53-b17b-d4322fa98ebd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:55.282757 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12a2b710-b5ba-4e53-b17b-d4322fa98ebd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:55.283395 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12a2b710-b5ba-4e53-b17b-d4322fa98ebd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:55.294523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12a2b710-b5ba-4e53-b17b-d4322fa98ebd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:55.294523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12a2b710-b5ba-4e53-b17b-d4322fa98ebd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:55.294523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12a2b710-b5ba-4e53-b17b-d4322fa98ebd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:55.460130 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-12a2b710-b5ba-4e53-b17b-d4322fa98ebd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:55.472412 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-12a2b710-b5ba-4e53-b17b-d4322fa98ebd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:55.473964 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-12a2b710-b5ba-4e53-b17b-d4322fa98ebd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:55.475144 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-12a2b710-b5ba-4e53-b17b-d4322fa98ebd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1740 microversion: 2.20 time: 0.209167 Aug 24 11:35:55.476282 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 491/968] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:55 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:56.501694 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7cac45dc-d3f1-47ba-a27b-a7410ca27297 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:56.502414 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7cac45dc-d3f1-47ba-a27b-a7410ca27297 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:56.511448 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7cac45dc-d3f1-47ba-a27b-a7410ca27297 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:56.514051 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7cac45dc-d3f1-47ba-a27b-a7410ca27297 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:56.514588 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7cac45dc-d3f1-47ba-a27b-a7410ca27297 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:56.515545 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7cac45dc-d3f1-47ba-a27b-a7410ca27297 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:56.516207 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7cac45dc-d3f1-47ba-a27b-a7410ca27297 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:56.516961 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7cac45dc-d3f1-47ba-a27b-a7410ca27297 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:56.676910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7cac45dc-d3f1-47ba-a27b-a7410ca27297 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:56.694110 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7cac45dc-d3f1-47ba-a27b-a7410ca27297 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:56.696167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7cac45dc-d3f1-47ba-a27b-a7410ca27297 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:56.697378 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7cac45dc-d3f1-47ba-a27b-a7410ca27297 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1740 microversion: 2.20 time: 0.199575 Aug 24 11:35:56.697971 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 478/969] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:56 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:57.720860 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b576608f-aa4c-4be3-b9df-4afcfb2acbcc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:57.721408 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b576608f-aa4c-4be3-b9df-4afcfb2acbcc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:57.729399 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b576608f-aa4c-4be3-b9df-4afcfb2acbcc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:57.729956 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b576608f-aa4c-4be3-b9df-4afcfb2acbcc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:57.730404 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b576608f-aa4c-4be3-b9df-4afcfb2acbcc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:57.731107 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b576608f-aa4c-4be3-b9df-4afcfb2acbcc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:57.731587 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b576608f-aa4c-4be3-b9df-4afcfb2acbcc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:57.732066 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b576608f-aa4c-4be3-b9df-4afcfb2acbcc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:57.882720 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b576608f-aa4c-4be3-b9df-4afcfb2acbcc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:57.891851 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b576608f-aa4c-4be3-b9df-4afcfb2acbcc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:57.895243 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b576608f-aa4c-4be3-b9df-4afcfb2acbcc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:57.896591 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b576608f-aa4c-4be3-b9df-4afcfb2acbcc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1740 microversion: 2.20 time: 0.179724 Aug 24 11:35:57.897535 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 492/970] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:57 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:35:58.921686 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-bc839c5b-a8fd-4db6-8bc1-6a0b3e46bb3e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:35:58.922686 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-bc839c5b-a8fd-4db6-8bc1-6a0b3e46bb3e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:35:58.930971 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bc839c5b-a8fd-4db6-8bc1-6a0b3e46bb3e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:58.932216 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bc839c5b-a8fd-4db6-8bc1-6a0b3e46bb3e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:58.932924 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bc839c5b-a8fd-4db6-8bc1-6a0b3e46bb3e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:58.934425 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bc839c5b-a8fd-4db6-8bc1-6a0b3e46bb3e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:35:58.935232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bc839c5b-a8fd-4db6-8bc1-6a0b3e46bb3e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:35:58.936180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bc839c5b-a8fd-4db6-8bc1-6a0b3e46bb3e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:35:59.114881 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-bc839c5b-a8fd-4db6-8bc1-6a0b3e46bb3e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:59.128605 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-bc839c5b-a8fd-4db6-8bc1-6a0b3e46bb3e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:59.130136 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-bc839c5b-a8fd-4db6-8bc1-6a0b3e46bb3e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:35:59.131544 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-bc839c5b-a8fd-4db6-8bc1-6a0b3e46bb3e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1740 microversion: 2.20 time: 0.214660 Aug 24 11:35:59.132570 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 479/971] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:35:58 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:00.158990 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-02f87529-2364-4788-aa1e-bfc29831ed45 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:00.159623 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-02f87529-2364-4788-aa1e-bfc29831ed45 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:00.167264 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02f87529-2364-4788-aa1e-bfc29831ed45 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:00.167853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02f87529-2364-4788-aa1e-bfc29831ed45 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:00.168398 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02f87529-2364-4788-aa1e-bfc29831ed45 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:00.169244 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02f87529-2364-4788-aa1e-bfc29831ed45 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:00.169811 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02f87529-2364-4788-aa1e-bfc29831ed45 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:00.170352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02f87529-2364-4788-aa1e-bfc29831ed45 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:00.312651 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-02f87529-2364-4788-aa1e-bfc29831ed45 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:00.320883 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-02f87529-2364-4788-aa1e-bfc29831ed45 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:00.322471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-02f87529-2364-4788-aa1e-bfc29831ed45 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:00.323971 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-02f87529-2364-4788-aa1e-bfc29831ed45 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1740 microversion: 2.20 time: 0.170003 Aug 24 11:36:00.324442 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 493/972] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:00 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:01.349217 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0f1b8d28-c567-4ca3-89fa-d948a8898b80 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:01.349821 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0f1b8d28-c567-4ca3-89fa-d948a8898b80 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:01.356626 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f1b8d28-c567-4ca3-89fa-d948a8898b80 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:01.357365 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f1b8d28-c567-4ca3-89fa-d948a8898b80 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:01.358017 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f1b8d28-c567-4ca3-89fa-d948a8898b80 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:01.358903 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f1b8d28-c567-4ca3-89fa-d948a8898b80 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:01.359589 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f1b8d28-c567-4ca3-89fa-d948a8898b80 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:01.360069 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0f1b8d28-c567-4ca3-89fa-d948a8898b80 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:01.510980 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0f1b8d28-c567-4ca3-89fa-d948a8898b80 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:01.520440 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0f1b8d28-c567-4ca3-89fa-d948a8898b80 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:01.522350 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0f1b8d28-c567-4ca3-89fa-d948a8898b80 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:01.524289 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0f1b8d28-c567-4ca3-89fa-d948a8898b80 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1740 microversion: 2.20 time: 0.179192 Aug 24 11:36:01.524852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 480/973] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:01 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:36:02.547130 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2281d882-51f8-41c7-a057-e46e5510adab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:02.548360 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2281d882-51f8-41c7-a057-e46e5510adab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:02.557853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2281d882-51f8-41c7-a057-e46e5510adab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:02.558497 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2281d882-51f8-41c7-a057-e46e5510adab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:02.559007 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2281d882-51f8-41c7-a057-e46e5510adab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:02.559813 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2281d882-51f8-41c7-a057-e46e5510adab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:02.564253 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2281d882-51f8-41c7-a057-e46e5510adab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:02.564253 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2281d882-51f8-41c7-a057-e46e5510adab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:02.721968 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2281d882-51f8-41c7-a057-e46e5510adab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:02.732845 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2281d882-51f8-41c7-a057-e46e5510adab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:02.734384 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2281d882-51f8-41c7-a057-e46e5510adab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:02.735558 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2281d882-51f8-41c7-a057-e46e5510adab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1740 microversion: 2.20 time: 0.192661 Aug 24 11:36:02.750372 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 494/974] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:02 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:03.759752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d1569040-8d01-4140-b7ed-dab02843dd98 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:03.761305 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d1569040-8d01-4140-b7ed-dab02843dd98 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:03.770626 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d1569040-8d01-4140-b7ed-dab02843dd98 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:03.771398 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d1569040-8d01-4140-b7ed-dab02843dd98 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:03.771999 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d1569040-8d01-4140-b7ed-dab02843dd98 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:03.774113 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d1569040-8d01-4140-b7ed-dab02843dd98 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:03.775051 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d1569040-8d01-4140-b7ed-dab02843dd98 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:03.775638 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d1569040-8d01-4140-b7ed-dab02843dd98 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:03.928481 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d1569040-8d01-4140-b7ed-dab02843dd98 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:03.937233 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d1569040-8d01-4140-b7ed-dab02843dd98 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:03.938891 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d1569040-8d01-4140-b7ed-dab02843dd98 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:03.940052 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d1569040-8d01-4140-b7ed-dab02843dd98 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1740 microversion: 2.20 time: 0.185219 Aug 24 11:36:03.940612 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 481/975] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:03 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:04.977983 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-11372d76-9046-4897-8c18-7cf20cf82854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:04.982379 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-11372d76-9046-4897-8c18-7cf20cf82854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:04.990481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11372d76-9046-4897-8c18-7cf20cf82854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:04.995011 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11372d76-9046-4897-8c18-7cf20cf82854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:04.995936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11372d76-9046-4897-8c18-7cf20cf82854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:04.996920 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11372d76-9046-4897-8c18-7cf20cf82854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:04.997445 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11372d76-9046-4897-8c18-7cf20cf82854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:04.997969 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11372d76-9046-4897-8c18-7cf20cf82854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:05.166559 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-11372d76-9046-4897-8c18-7cf20cf82854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:05.177183 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-11372d76-9046-4897-8c18-7cf20cf82854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:05.180185 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-11372d76-9046-4897-8c18-7cf20cf82854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:05.181393 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-11372d76-9046-4897-8c18-7cf20cf82854 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1740 microversion: 2.20 time: 0.219622 Aug 24 11:36:05.182193 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 495/976] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:04 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:06.213991 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d82dc8a7-3c24-4ad6-a125-9280abcfe527 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:06.215072 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d82dc8a7-3c24-4ad6-a125-9280abcfe527 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:06.221194 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d82dc8a7-3c24-4ad6-a125-9280abcfe527 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:06.221767 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d82dc8a7-3c24-4ad6-a125-9280abcfe527 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:06.222309 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d82dc8a7-3c24-4ad6-a125-9280abcfe527 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:06.223025 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d82dc8a7-3c24-4ad6-a125-9280abcfe527 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:06.223462 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d82dc8a7-3c24-4ad6-a125-9280abcfe527 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:06.223890 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d82dc8a7-3c24-4ad6-a125-9280abcfe527 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:06.358458 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d82dc8a7-3c24-4ad6-a125-9280abcfe527 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:06.367307 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d82dc8a7-3c24-4ad6-a125-9280abcfe527 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:06.368823 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d82dc8a7-3c24-4ad6-a125-9280abcfe527 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:06.370018 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d82dc8a7-3c24-4ad6-a125-9280abcfe527 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1740 microversion: 2.20 time: 0.160862 Aug 24 11:36:06.370580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 482/977] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:06 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:07.393111 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a741f2cb-f37c-487e-be89-ff6926937ef0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:07.393734 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a741f2cb-f37c-487e-be89-ff6926937ef0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:07.404759 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a741f2cb-f37c-487e-be89-ff6926937ef0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:07.405251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a741f2cb-f37c-487e-be89-ff6926937ef0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:07.405688 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a741f2cb-f37c-487e-be89-ff6926937ef0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:07.406429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a741f2cb-f37c-487e-be89-ff6926937ef0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:07.406879 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a741f2cb-f37c-487e-be89-ff6926937ef0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:07.407309 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a741f2cb-f37c-487e-be89-ff6926937ef0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:07.586838 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a741f2cb-f37c-487e-be89-ff6926937ef0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:07.595767 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a741f2cb-f37c-487e-be89-ff6926937ef0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:07.597348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a741f2cb-f37c-487e-be89-ff6926937ef0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:07.598946 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a741f2cb-f37c-487e-be89-ff6926937ef0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1722 microversion: 2.20 time: 0.209396 Aug 24 11:36:07.599140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 496/978] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:07 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:08.622129 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-739751b0-b876-4f8c-8bc4-0d8dbe9112f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:08.622699 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-739751b0-b876-4f8c-8bc4-0d8dbe9112f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:08.629011 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-739751b0-b876-4f8c-8bc4-0d8dbe9112f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:08.629497 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-739751b0-b876-4f8c-8bc4-0d8dbe9112f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:08.629965 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-739751b0-b876-4f8c-8bc4-0d8dbe9112f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:08.630670 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-739751b0-b876-4f8c-8bc4-0d8dbe9112f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:08.631125 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-739751b0-b876-4f8c-8bc4-0d8dbe9112f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:08.631552 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-739751b0-b876-4f8c-8bc4-0d8dbe9112f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:08.769745 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-739751b0-b876-4f8c-8bc4-0d8dbe9112f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:08.778634 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-739751b0-b876-4f8c-8bc4-0d8dbe9112f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:08.780246 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-739751b0-b876-4f8c-8bc4-0d8dbe9112f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:08.781542 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-739751b0-b876-4f8c-8bc4-0d8dbe9112f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1722 microversion: 2.20 time: 0.163541 Aug 24 11:36:08.782247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 483/979] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:08 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:09.469780 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-d7b7901e-12ff-465c-87fd-5d534dc5a9ab req-f093782f-e386-4a96-ba61-ede14f3df202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c6a206-49d7-44b6-a24f-f5961f099597", "name": "network-vif-unplugged", "status": "completed", "tag": "dfa0d250-97f7-4d9a-9f1c-edee2d559865"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:36:09.480823 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-d7b7901e-12ff-465c-87fd-5d534dc5a9ab req-f093782f-e386-4a96-ba61-ede14f3df202 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:09.481307 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-d7b7901e-12ff-465c-87fd-5d534dc5a9ab req-f093782f-e386-4a96-ba61-ede14f3df202 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:09.481741 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-d7b7901e-12ff-465c-87fd-5d534dc5a9ab req-f093782f-e386-4a96-ba61-ede14f3df202 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:09.493282 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-d7b7901e-12ff-465c-87fd-5d534dc5a9ab req-f093782f-e386-4a96-ba61-ede14f3df202 service nova] Creating event network-vif-unplugged:dfa0d250-97f7-4d9a-9f1c-edee2d559865 for instance 17c6a206-49d7-44b6-a24f-f5961f099597 on hv-cinder-85427 Aug 24 11:36:09.498534 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-d7b7901e-12ff-465c-87fd-5d534dc5a9ab req-f093782f-e386-4a96-ba61-ede14f3df202 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032776 Aug 24 11:36:09.499317 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 497/980] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:36:09.805407 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5b6173a0-8cf9-48ec-b34f-9b657f5ca99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:09.806209 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5b6173a0-8cf9-48ec-b34f-9b657f5ca99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:09.814732 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b6173a0-8cf9-48ec-b34f-9b657f5ca99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:09.815220 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b6173a0-8cf9-48ec-b34f-9b657f5ca99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:09.815657 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b6173a0-8cf9-48ec-b34f-9b657f5ca99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:09.816358 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b6173a0-8cf9-48ec-b34f-9b657f5ca99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:09.816810 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b6173a0-8cf9-48ec-b34f-9b657f5ca99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:09.817225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b6173a0-8cf9-48ec-b34f-9b657f5ca99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:09.954767 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5b6173a0-8cf9-48ec-b34f-9b657f5ca99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:09.964081 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5b6173a0-8cf9-48ec-b34f-9b657f5ca99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:09.965820 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5b6173a0-8cf9-48ec-b34f-9b657f5ca99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:09.967300 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5b6173a0-8cf9-48ec-b34f-9b657f5ca99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1722 microversion: 2.20 time: 0.166439 Aug 24 11:36:09.967933 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 484/981] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:09 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:10.990660 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-98b2a177-5cb3-4153-a98b-ba1770ccab66 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:10.991284 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-98b2a177-5cb3-4153-a98b-ba1770ccab66 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:10.998012 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-98b2a177-5cb3-4153-a98b-ba1770ccab66 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:10.998500 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-98b2a177-5cb3-4153-a98b-ba1770ccab66 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:10.998938 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-98b2a177-5cb3-4153-a98b-ba1770ccab66 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:10.999736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-98b2a177-5cb3-4153-a98b-ba1770ccab66 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:11.000197 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-98b2a177-5cb3-4153-a98b-ba1770ccab66 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:11.000623 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-98b2a177-5cb3-4153-a98b-ba1770ccab66 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:11.136227 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-98b2a177-5cb3-4153-a98b-ba1770ccab66 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:11.144733 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-98b2a177-5cb3-4153-a98b-ba1770ccab66 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:11.146275 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-98b2a177-5cb3-4153-a98b-ba1770ccab66 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:11.147470 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-98b2a177-5cb3-4153-a98b-ba1770ccab66 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1725 microversion: 2.20 time: 0.161232 Aug 24 11:36:11.148590 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 498/982] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:10 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:11.170700 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b2bd96b0-1a17-4824-85d3-ec848de519e2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10f88693-dd0d-4e6b-874b-3a03302ba4df"}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:36:11.173314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b2bd96b0-1a17-4824-85d3-ec848de519e2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:11.179909 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b2bd96b0-1a17-4824-85d3-ec848de519e2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:11.180396 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b2bd96b0-1a17-4824-85d3-ec848de519e2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:11.180830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b2bd96b0-1a17-4824-85d3-ec848de519e2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:11.181523 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b2bd96b0-1a17-4824-85d3-ec848de519e2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:11.182011 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b2bd96b0-1a17-4824-85d3-ec848de519e2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:11.182442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b2bd96b0-1a17-4824-85d3-ec848de519e2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:12.383935 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:12.519686 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b2bd96b0-1a17-4824-85d3-ec848de519e2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "POST /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.353002 Aug 24 11:36:12.520385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 485/983] 10.222.0.83 () {62 vars in 1364 bytes} [Wed Aug 24 11:36:11 2022] POST /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/os-volume_attachments => generated 188 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:36:12.650480 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b96d118d-c0dd-4d51-973b-397264776969 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:36:12.651090 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b96d118d-c0dd-4d51-973b-397264776969 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:12.657909 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b96d118d-c0dd-4d51-973b-397264776969 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:12.658425 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b96d118d-c0dd-4d51-973b-397264776969 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:12.658914 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b96d118d-c0dd-4d51-973b-397264776969 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:12.659552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b96d118d-c0dd-4d51-973b-397264776969 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:12.660008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b96d118d-c0dd-4d51-973b-397264776969 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:12.660457 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b96d118d-c0dd-4d51-973b-397264776969 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:12.690736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b96d118d-c0dd-4d51-973b-397264776969 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121221) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 11:36:13.034650 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b96d118d-c0dd-4d51-973b-397264776969 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "POST /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/action" status: 202 len: 0 microversion: 2.20 time: 0.388333 Aug 24 11:36:13.035262 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 499/984] 10.222.0.83 () {62 vars in 1319 bytes} [Wed Aug 24 11:36:12 2022] POST /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:36:13.044184 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-04ab7758-f0d6-4bdd-8c8d-d5b36af9de05 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:13.044789 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-04ab7758-f0d6-4bdd-8c8d-d5b36af9de05 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:13.051965 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-04ab7758-f0d6-4bdd-8c8d-d5b36af9de05 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:13.052460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-04ab7758-f0d6-4bdd-8c8d-d5b36af9de05 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:13.052904 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-04ab7758-f0d6-4bdd-8c8d-d5b36af9de05 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:13.053597 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-04ab7758-f0d6-4bdd-8c8d-d5b36af9de05 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:13.054070 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-04ab7758-f0d6-4bdd-8c8d-d5b36af9de05 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:13.054529 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-04ab7758-f0d6-4bdd-8c8d-d5b36af9de05 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:13.201567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-04ab7758-f0d6-4bdd-8c8d-d5b36af9de05 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:13.208597 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-04ab7758-f0d6-4bdd-8c8d-d5b36af9de05 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:13.210146 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-04ab7758-f0d6-4bdd-8c8d-d5b36af9de05 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:13.211923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-04ab7758-f0d6-4bdd-8c8d-d5b36af9de05 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1751 microversion: 2.20 time: 0.172234 Aug 24 11:36:13.212487 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 486/985] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:13 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:14.235163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0bd48076-6c29-4a28-b499-f352ed6960f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:14.235917 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0bd48076-6c29-4a28-b499-f352ed6960f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:14.243519 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bd48076-6c29-4a28-b499-f352ed6960f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:14.244560 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bd48076-6c29-4a28-b499-f352ed6960f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:14.245673 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bd48076-6c29-4a28-b499-f352ed6960f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:14.246848 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bd48076-6c29-4a28-b499-f352ed6960f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:14.247880 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bd48076-6c29-4a28-b499-f352ed6960f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:14.249001 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bd48076-6c29-4a28-b499-f352ed6960f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:14.269495 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:14.388103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0bd48076-6c29-4a28-b499-f352ed6960f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:14.396650 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0bd48076-6c29-4a28-b499-f352ed6960f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:14.398257 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0bd48076-6c29-4a28-b499-f352ed6960f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:14.399559 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0bd48076-6c29-4a28-b499-f352ed6960f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1751 microversion: 2.20 time: 0.168759 Aug 24 11:36:14.400129 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 500/986] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:14 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:15.422698 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6cc73c08-93f3-448c-a5d1-14d7da7d4bdc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:15.423300 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6cc73c08-93f3-448c-a5d1-14d7da7d4bdc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:15.429942 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6cc73c08-93f3-448c-a5d1-14d7da7d4bdc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:15.430421 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6cc73c08-93f3-448c-a5d1-14d7da7d4bdc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:15.430846 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6cc73c08-93f3-448c-a5d1-14d7da7d4bdc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:15.431535 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6cc73c08-93f3-448c-a5d1-14d7da7d4bdc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:15.432009 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6cc73c08-93f3-448c-a5d1-14d7da7d4bdc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:15.432425 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6cc73c08-93f3-448c-a5d1-14d7da7d4bdc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:15.571157 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6cc73c08-93f3-448c-a5d1-14d7da7d4bdc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:15.579948 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6cc73c08-93f3-448c-a5d1-14d7da7d4bdc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:15.581441 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6cc73c08-93f3-448c-a5d1-14d7da7d4bdc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:15.582624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6cc73c08-93f3-448c-a5d1-14d7da7d4bdc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1753 microversion: 2.20 time: 0.163863 Aug 24 11:36:15.583182 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 487/987] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:15 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:16.606104 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bde5587e-f1f9-4bab-b452-aab2b0271f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:16.606726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bde5587e-f1f9-4bab-b452-aab2b0271f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:16.614174 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bde5587e-f1f9-4bab-b452-aab2b0271f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:16.614669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bde5587e-f1f9-4bab-b452-aab2b0271f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:16.615114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bde5587e-f1f9-4bab-b452-aab2b0271f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:16.615823 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bde5587e-f1f9-4bab-b452-aab2b0271f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:16.616280 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bde5587e-f1f9-4bab-b452-aab2b0271f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:16.616705 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bde5587e-f1f9-4bab-b452-aab2b0271f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:16.758236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bde5587e-f1f9-4bab-b452-aab2b0271f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:16.763397 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bde5587e-f1f9-4bab-b452-aab2b0271f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:16.764914 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bde5587e-f1f9-4bab-b452-aab2b0271f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:16.766116 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bde5587e-f1f9-4bab-b452-aab2b0271f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1753 microversion: 2.20 time: 0.164218 Aug 24 11:36:16.766684 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 501/988] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:16 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:17.790522 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a15c11c9-80e9-4c1b-9047-7c230cc0b73d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:17.791142 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a15c11c9-80e9-4c1b-9047-7c230cc0b73d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:17.793515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=30 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:17.798326 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a15c11c9-80e9-4c1b-9047-7c230cc0b73d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:17.798814 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a15c11c9-80e9-4c1b-9047-7c230cc0b73d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:17.799251 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a15c11c9-80e9-4c1b-9047-7c230cc0b73d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:17.799975 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a15c11c9-80e9-4c1b-9047-7c230cc0b73d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:17.800508 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a15c11c9-80e9-4c1b-9047-7c230cc0b73d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:17.800937 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a15c11c9-80e9-4c1b-9047-7c230cc0b73d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:18.000618 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a15c11c9-80e9-4c1b-9047-7c230cc0b73d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:18.009731 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a15c11c9-80e9-4c1b-9047-7c230cc0b73d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:18.011613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a15c11c9-80e9-4c1b-9047-7c230cc0b73d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:18.012798 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a15c11c9-80e9-4c1b-9047-7c230cc0b73d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.227161 Aug 24 11:36:18.013354 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 488/989] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:17 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:19.047759 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-eb6717b6-2f4f-4731-b3cd-8a1bd1ee897b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:19.047759 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-eb6717b6-2f4f-4731-b3cd-8a1bd1ee897b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:19.052316 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb6717b6-2f4f-4731-b3cd-8a1bd1ee897b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:19.053273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb6717b6-2f4f-4731-b3cd-8a1bd1ee897b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:19.054034 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb6717b6-2f4f-4731-b3cd-8a1bd1ee897b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:19.055183 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb6717b6-2f4f-4731-b3cd-8a1bd1ee897b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:19.056099 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb6717b6-2f4f-4731-b3cd-8a1bd1ee897b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:19.057995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb6717b6-2f4f-4731-b3cd-8a1bd1ee897b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:19.214757 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-eb6717b6-2f4f-4731-b3cd-8a1bd1ee897b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:19.223910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-eb6717b6-2f4f-4731-b3cd-8a1bd1ee897b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:19.225472 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-eb6717b6-2f4f-4731-b3cd-8a1bd1ee897b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:19.227218 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-eb6717b6-2f4f-4731-b3cd-8a1bd1ee897b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.193643 Aug 24 11:36:19.228088 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 502/990] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:19 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:20.250712 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5b619a5a-50b7-42f3-950b-8b818a24181c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:20.251273 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5b619a5a-50b7-42f3-950b-8b818a24181c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:20.258922 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b619a5a-50b7-42f3-950b-8b818a24181c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:20.258922 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b619a5a-50b7-42f3-950b-8b818a24181c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:20.258922 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b619a5a-50b7-42f3-950b-8b818a24181c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:20.259328 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b619a5a-50b7-42f3-950b-8b818a24181c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:20.259783 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b619a5a-50b7-42f3-950b-8b818a24181c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:20.260209 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5b619a5a-50b7-42f3-950b-8b818a24181c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:20.400407 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5b619a5a-50b7-42f3-950b-8b818a24181c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:20.409951 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5b619a5a-50b7-42f3-950b-8b818a24181c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:20.411463 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5b619a5a-50b7-42f3-950b-8b818a24181c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:20.412638 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5b619a5a-50b7-42f3-950b-8b818a24181c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.165973 Aug 24 11:36:20.413234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 489/991] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:20 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:21.436797 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7af81e2d-cd00-443f-928d-4ce7e01618f8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:21.439299 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7af81e2d-cd00-443f-928d-4ce7e01618f8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:21.444709 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7af81e2d-cd00-443f-928d-4ce7e01618f8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:21.445791 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7af81e2d-cd00-443f-928d-4ce7e01618f8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:21.446259 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7af81e2d-cd00-443f-928d-4ce7e01618f8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:21.446976 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7af81e2d-cd00-443f-928d-4ce7e01618f8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:21.447438 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7af81e2d-cd00-443f-928d-4ce7e01618f8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:21.447866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7af81e2d-cd00-443f-928d-4ce7e01618f8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:21.592267 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7af81e2d-cd00-443f-928d-4ce7e01618f8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:21.603374 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7af81e2d-cd00-443f-928d-4ce7e01618f8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:21.607899 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7af81e2d-cd00-443f-928d-4ce7e01618f8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:21.607899 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7af81e2d-cd00-443f-928d-4ce7e01618f8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.173471 Aug 24 11:36:21.607899 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 503/992] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:21 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:22.630416 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-761574fd-3c3e-4839-a57b-32075b0247aa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:22.631019 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-761574fd-3c3e-4839-a57b-32075b0247aa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:22.638976 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-761574fd-3c3e-4839-a57b-32075b0247aa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:22.644134 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-761574fd-3c3e-4839-a57b-32075b0247aa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:22.644134 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-761574fd-3c3e-4839-a57b-32075b0247aa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:22.644134 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-761574fd-3c3e-4839-a57b-32075b0247aa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:22.644134 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-761574fd-3c3e-4839-a57b-32075b0247aa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:22.644560 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-761574fd-3c3e-4839-a57b-32075b0247aa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:22.828422 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-761574fd-3c3e-4839-a57b-32075b0247aa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:22.837918 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-761574fd-3c3e-4839-a57b-32075b0247aa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:22.839708 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-761574fd-3c3e-4839-a57b-32075b0247aa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:22.841095 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-761574fd-3c3e-4839-a57b-32075b0247aa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.214699 Aug 24 11:36:22.854497 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 490/993] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:22 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:23.870333 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f54c0ff4-2550-4c61-ab48-9f7ba34ef86b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:23.871134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f54c0ff4-2550-4c61-ab48-9f7ba34ef86b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:23.877416 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f54c0ff4-2550-4c61-ab48-9f7ba34ef86b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:23.878158 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f54c0ff4-2550-4c61-ab48-9f7ba34ef86b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:23.878762 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f54c0ff4-2550-4c61-ab48-9f7ba34ef86b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:23.879663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f54c0ff4-2550-4c61-ab48-9f7ba34ef86b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:23.880286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f54c0ff4-2550-4c61-ab48-9f7ba34ef86b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:23.880877 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f54c0ff4-2550-4c61-ab48-9f7ba34ef86b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:24.059320 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f54c0ff4-2550-4c61-ab48-9f7ba34ef86b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:24.069430 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f54c0ff4-2550-4c61-ab48-9f7ba34ef86b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:24.071527 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f54c0ff4-2550-4c61-ab48-9f7ba34ef86b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:24.077023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f54c0ff4-2550-4c61-ab48-9f7ba34ef86b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.210617 Aug 24 11:36:24.090725 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 504/994] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:23 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:36:25.032952 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9fdf9ac0-8574-435f-98b9-45c6829884df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:25.033658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9fdf9ac0-8574-435f-98b9-45c6829884df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:25.040408 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fdf9ac0-8574-435f-98b9-45c6829884df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:25.040883 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fdf9ac0-8574-435f-98b9-45c6829884df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:25.044787 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fdf9ac0-8574-435f-98b9-45c6829884df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:25.044787 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fdf9ac0-8574-435f-98b9-45c6829884df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:25.044787 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fdf9ac0-8574-435f-98b9-45c6829884df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:25.044787 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fdf9ac0-8574-435f-98b9-45c6829884df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:25.069846 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9fdf9ac0-8574-435f-98b9-45c6829884df tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba/ips" status: 200 len: 150 microversion: 2.1 time: 0.040601 Aug 24 11:36:25.071335 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 491/995] 10.222.0.83 () {58 vars in 1248 bytes} [Wed Aug 24 11:36:25 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:36:25.120218 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-09fd1df5-566e-486d-8ccd-7e34b03cec02 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:25.120218 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-09fd1df5-566e-486d-8ccd-7e34b03cec02 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:25.120218 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-09fd1df5-566e-486d-8ccd-7e34b03cec02 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:25.120218 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-09fd1df5-566e-486d-8ccd-7e34b03cec02 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:25.126489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-09fd1df5-566e-486d-8ccd-7e34b03cec02 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:25.126489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-09fd1df5-566e-486d-8ccd-7e34b03cec02 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:25.126489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-09fd1df5-566e-486d-8ccd-7e34b03cec02 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:25.126489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-09fd1df5-566e-486d-8ccd-7e34b03cec02 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:25.293282 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-09fd1df5-566e-486d-8ccd-7e34b03cec02 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:25.303822 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-09fd1df5-566e-486d-8ccd-7e34b03cec02 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:25.306308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-09fd1df5-566e-486d-8ccd-7e34b03cec02 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:25.307635 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-09fd1df5-566e-486d-8ccd-7e34b03cec02 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.210215 Aug 24 11:36:25.308278 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 505/996] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:25 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:26.332956 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3bbc950c-87d8-4528-8470-770bdb5ca4c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:26.334105 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3bbc950c-87d8-4528-8470-770bdb5ca4c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:26.340882 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3bbc950c-87d8-4528-8470-770bdb5ca4c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:26.341605 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3bbc950c-87d8-4528-8470-770bdb5ca4c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:26.342597 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3bbc950c-87d8-4528-8470-770bdb5ca4c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:26.343504 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3bbc950c-87d8-4528-8470-770bdb5ca4c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:26.344140 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3bbc950c-87d8-4528-8470-770bdb5ca4c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:26.344744 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3bbc950c-87d8-4528-8470-770bdb5ca4c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:26.496207 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3bbc950c-87d8-4528-8470-770bdb5ca4c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:26.506580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3bbc950c-87d8-4528-8470-770bdb5ca4c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:26.508309 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3bbc950c-87d8-4528-8470-770bdb5ca4c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:26.509922 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3bbc950c-87d8-4528-8470-770bdb5ca4c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.180905 Aug 24 11:36:26.526385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 492/997] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:26 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:27.536175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fa28bfcc-c2dc-4f07-ac04-48eca3aef738 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:27.537648 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fa28bfcc-c2dc-4f07-ac04-48eca3aef738 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:27.544273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:27.550635 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa28bfcc-c2dc-4f07-ac04-48eca3aef738 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:27.550635 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa28bfcc-c2dc-4f07-ac04-48eca3aef738 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:27.550635 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa28bfcc-c2dc-4f07-ac04-48eca3aef738 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:27.550635 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa28bfcc-c2dc-4f07-ac04-48eca3aef738 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:27.551049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa28bfcc-c2dc-4f07-ac04-48eca3aef738 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:27.551049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa28bfcc-c2dc-4f07-ac04-48eca3aef738 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:27.698498 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fa28bfcc-c2dc-4f07-ac04-48eca3aef738 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:27.707521 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fa28bfcc-c2dc-4f07-ac04-48eca3aef738 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:27.709041 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fa28bfcc-c2dc-4f07-ac04-48eca3aef738 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:27.710253 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fa28bfcc-c2dc-4f07-ac04-48eca3aef738 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.179012 Aug 24 11:36:27.710854 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 506/998] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:27 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:28.165467 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-83004695-e484-40e0-9442-07a07b5f79d4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4988366-333e-419e-88fa-21ee2222df6c"}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:36:28.168020 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-83004695-e484-40e0-9442-07a07b5f79d4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:28.175050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-83004695-e484-40e0-9442-07a07b5f79d4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:28.175536 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-83004695-e484-40e0-9442-07a07b5f79d4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:28.175965 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-83004695-e484-40e0-9442-07a07b5f79d4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:28.176659 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-83004695-e484-40e0-9442-07a07b5f79d4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:28.177109 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-83004695-e484-40e0-9442-07a07b5f79d4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:28.177528 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-83004695-e484-40e0-9442-07a07b5f79d4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:28.735228 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2669ce92-ea4e-4f5c-ac3b-e48360f53677 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:28.735902 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2669ce92-ea4e-4f5c-ac3b-e48360f53677 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:28.743733 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2669ce92-ea4e-4f5c-ac3b-e48360f53677 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:28.744160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2669ce92-ea4e-4f5c-ac3b-e48360f53677 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:28.744596 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2669ce92-ea4e-4f5c-ac3b-e48360f53677 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:28.745380 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2669ce92-ea4e-4f5c-ac3b-e48360f53677 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:28.745837 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2669ce92-ea4e-4f5c-ac3b-e48360f53677 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:28.746283 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2669ce92-ea4e-4f5c-ac3b-e48360f53677 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:28.881108 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2669ce92-ea4e-4f5c-ac3b-e48360f53677 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:28.890783 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2669ce92-ea4e-4f5c-ac3b-e48360f53677 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:28.892307 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2669ce92-ea4e-4f5c-ac3b-e48360f53677 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:28.893486 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2669ce92-ea4e-4f5c-ac3b-e48360f53677 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.162239 Aug 24 11:36:28.894075 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 507/999] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:28 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:36:29.916197 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4164e188-7aeb-4a85-bb8f-7dba4f6b1232 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:29.916890 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4164e188-7aeb-4a85-bb8f-7dba4f6b1232 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:29.923178 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4164e188-7aeb-4a85-bb8f-7dba4f6b1232 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:29.923673 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4164e188-7aeb-4a85-bb8f-7dba4f6b1232 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:29.924113 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4164e188-7aeb-4a85-bb8f-7dba4f6b1232 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:29.924814 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4164e188-7aeb-4a85-bb8f-7dba4f6b1232 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:29.925271 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4164e188-7aeb-4a85-bb8f-7dba4f6b1232 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:29.925699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4164e188-7aeb-4a85-bb8f-7dba4f6b1232 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:30.060787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4164e188-7aeb-4a85-bb8f-7dba4f6b1232 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:30.069427 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4164e188-7aeb-4a85-bb8f-7dba4f6b1232 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:30.071503 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4164e188-7aeb-4a85-bb8f-7dba4f6b1232 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:30.072692 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4164e188-7aeb-4a85-bb8f-7dba4f6b1232 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.160417 Aug 24 11:36:30.073245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 508/1000] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:29 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:36:31.095790 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0b7f8da8-743f-42e4-897b-3903c5ce1ee9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:31.096426 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0b7f8da8-743f-42e4-897b-3903c5ce1ee9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:31.103499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0b7f8da8-743f-42e4-897b-3903c5ce1ee9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:31.103995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0b7f8da8-743f-42e4-897b-3903c5ce1ee9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:31.104436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0b7f8da8-743f-42e4-897b-3903c5ce1ee9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:31.105134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0b7f8da8-743f-42e4-897b-3903c5ce1ee9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:31.105939 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0b7f8da8-743f-42e4-897b-3903c5ce1ee9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:31.106166 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0b7f8da8-743f-42e4-897b-3903c5ce1ee9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:31.242283 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0b7f8da8-743f-42e4-897b-3903c5ce1ee9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:31.251247 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0b7f8da8-743f-42e4-897b-3903c5ce1ee9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:31.252761 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0b7f8da8-743f-42e4-897b-3903c5ce1ee9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:31.253992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0b7f8da8-743f-42e4-897b-3903c5ce1ee9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.162148 Aug 24 11:36:31.254555 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 509/1001] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:31 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:36:32.183926 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-83004695-e484-40e0-9442-07a07b5f79d4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "POST /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.022837 Aug 24 11:36:32.192977 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 493/1002] 10.222.0.83 () {60 vars in 1323 bytes} [Wed Aug 24 11:36:28 2022] POST /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba/os-volume_attachments => generated 194 bytes in 4024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:36:32.277488 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fd425fa0-668a-4aeb-80fa-04c6db83e5e1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:32.278271 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fd425fa0-668a-4aeb-80fa-04c6db83e5e1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:32.287068 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd425fa0-668a-4aeb-80fa-04c6db83e5e1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:32.287552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd425fa0-668a-4aeb-80fa-04c6db83e5e1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:32.287985 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd425fa0-668a-4aeb-80fa-04c6db83e5e1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:32.289210 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd425fa0-668a-4aeb-80fa-04c6db83e5e1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:32.289660 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd425fa0-668a-4aeb-80fa-04c6db83e5e1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:32.290102 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd425fa0-668a-4aeb-80fa-04c6db83e5e1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:32.440537 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fd425fa0-668a-4aeb-80fa-04c6db83e5e1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:32.449668 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fd425fa0-668a-4aeb-80fa-04c6db83e5e1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:32.451227 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fd425fa0-668a-4aeb-80fa-04c6db83e5e1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:32.452520 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fd425fa0-668a-4aeb-80fa-04c6db83e5e1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.179051 Aug 24 11:36:32.453082 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 510/1003] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:32 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:33.477329 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d6856e79-d32d-4f73-abfc-4c3679ac1240 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:33.478063 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d6856e79-d32d-4f73-abfc-4c3679ac1240 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:33.486187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d6856e79-d32d-4f73-abfc-4c3679ac1240 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:33.486684 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d6856e79-d32d-4f73-abfc-4c3679ac1240 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:33.487119 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d6856e79-d32d-4f73-abfc-4c3679ac1240 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:33.487811 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d6856e79-d32d-4f73-abfc-4c3679ac1240 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:33.488259 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d6856e79-d32d-4f73-abfc-4c3679ac1240 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:33.488680 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d6856e79-d32d-4f73-abfc-4c3679ac1240 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:33.626439 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d6856e79-d32d-4f73-abfc-4c3679ac1240 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:33.636165 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d6856e79-d32d-4f73-abfc-4c3679ac1240 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:33.642460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d6856e79-d32d-4f73-abfc-4c3679ac1240 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:33.642460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d6856e79-d32d-4f73-abfc-4c3679ac1240 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.166365 Aug 24 11:36:33.642460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 494/1004] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:33 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:34.662496 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1b773da5-c676-4ceb-8346-d5e3d91df47d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:34.663179 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1b773da5-c676-4ceb-8346-d5e3d91df47d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:34.670429 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b773da5-c676-4ceb-8346-d5e3d91df47d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:34.670616 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b773da5-c676-4ceb-8346-d5e3d91df47d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:34.671046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b773da5-c676-4ceb-8346-d5e3d91df47d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:34.671752 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b773da5-c676-4ceb-8346-d5e3d91df47d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:34.672600 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b773da5-c676-4ceb-8346-d5e3d91df47d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:34.673021 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1b773da5-c676-4ceb-8346-d5e3d91df47d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:34.811166 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1b773da5-c676-4ceb-8346-d5e3d91df47d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:34.820692 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1b773da5-c676-4ceb-8346-d5e3d91df47d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:34.822238 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1b773da5-c676-4ceb-8346-d5e3d91df47d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:34.823401 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1b773da5-c676-4ceb-8346-d5e3d91df47d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.165226 Aug 24 11:36:34.823963 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 511/1005] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:34 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:35.845919 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2c5d9c14-d2e6-444f-9cf0-c196c4d40f59 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:35.851666 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-2c5d9c14-d2e6-444f-9cf0-c196c4d40f59 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:35.853224 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2c5d9c14-d2e6-444f-9cf0-c196c4d40f59 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:35.853712 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2c5d9c14-d2e6-444f-9cf0-c196c4d40f59 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:35.854180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2c5d9c14-d2e6-444f-9cf0-c196c4d40f59 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:35.854874 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2c5d9c14-d2e6-444f-9cf0-c196c4d40f59 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:35.855325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2c5d9c14-d2e6-444f-9cf0-c196c4d40f59 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:35.855750 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2c5d9c14-d2e6-444f-9cf0-c196c4d40f59 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:35.987658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-2c5d9c14-d2e6-444f-9cf0-c196c4d40f59 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:35.996456 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-2c5d9c14-d2e6-444f-9cf0-c196c4d40f59 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:35.997963 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-2c5d9c14-d2e6-444f-9cf0-c196c4d40f59 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:35.999140 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-2c5d9c14-d2e6-444f-9cf0-c196c4d40f59 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.157127 Aug 24 11:36:35.999684 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 495/1006] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:35 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:37.022410 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8896b695-c122-4f79-a2a9-6a5df729382a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:37.022959 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8896b695-c122-4f79-a2a9-6a5df729382a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:37.029277 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8896b695-c122-4f79-a2a9-6a5df729382a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:37.029748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8896b695-c122-4f79-a2a9-6a5df729382a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:37.030220 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8896b695-c122-4f79-a2a9-6a5df729382a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:37.030904 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8896b695-c122-4f79-a2a9-6a5df729382a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:37.031346 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8896b695-c122-4f79-a2a9-6a5df729382a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:37.031762 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8896b695-c122-4f79-a2a9-6a5df729382a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:37.168453 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8896b695-c122-4f79-a2a9-6a5df729382a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:37.177374 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8896b695-c122-4f79-a2a9-6a5df729382a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:37.178921 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8896b695-c122-4f79-a2a9-6a5df729382a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:37.180090 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8896b695-c122-4f79-a2a9-6a5df729382a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.161682 Aug 24 11:36:37.181226 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 512/1007] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:37 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:38.203214 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4dd1eff6-8ca0-42fb-9b1b-db50bc05b0eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:38.207983 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4dd1eff6-8ca0-42fb-9b1b-db50bc05b0eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:38.210630 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4dd1eff6-8ca0-42fb-9b1b-db50bc05b0eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:38.211145 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4dd1eff6-8ca0-42fb-9b1b-db50bc05b0eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:38.212580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4dd1eff6-8ca0-42fb-9b1b-db50bc05b0eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:38.213276 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4dd1eff6-8ca0-42fb-9b1b-db50bc05b0eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:38.213728 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4dd1eff6-8ca0-42fb-9b1b-db50bc05b0eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:38.214191 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4dd1eff6-8ca0-42fb-9b1b-db50bc05b0eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:38.369013 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4dd1eff6-8ca0-42fb-9b1b-db50bc05b0eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:38.377706 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4dd1eff6-8ca0-42fb-9b1b-db50bc05b0eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:38.379240 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4dd1eff6-8ca0-42fb-9b1b-db50bc05b0eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:38.380413 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4dd1eff6-8ca0-42fb-9b1b-db50bc05b0eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.181218 Aug 24 11:36:38.380974 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 496/1008] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:38 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:39.404217 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4d561a98-b608-44fe-b72e-e5a730ded076 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:39.404866 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4d561a98-b608-44fe-b72e-e5a730ded076 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:39.411378 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4d561a98-b608-44fe-b72e-e5a730ded076 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:39.413057 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4d561a98-b608-44fe-b72e-e5a730ded076 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:39.413057 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4d561a98-b608-44fe-b72e-e5a730ded076 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:39.413057 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4d561a98-b608-44fe-b72e-e5a730ded076 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:39.413568 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4d561a98-b608-44fe-b72e-e5a730ded076 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:39.414020 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4d561a98-b608-44fe-b72e-e5a730ded076 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:39.544178 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4d561a98-b608-44fe-b72e-e5a730ded076 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:39.553096 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4d561a98-b608-44fe-b72e-e5a730ded076 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:39.554660 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4d561a98-b608-44fe-b72e-e5a730ded076 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:39.555846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4d561a98-b608-44fe-b72e-e5a730ded076 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.155643 Aug 24 11:36:39.559590 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 513/1009] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:39 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:40.578754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-eb617b5e-831c-4187-9287-3325f27ea3e7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:40.579328 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-eb617b5e-831c-4187-9287-3325f27ea3e7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:40.586006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb617b5e-831c-4187-9287-3325f27ea3e7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:40.588863 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb617b5e-831c-4187-9287-3325f27ea3e7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:40.588863 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb617b5e-831c-4187-9287-3325f27ea3e7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:40.588863 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb617b5e-831c-4187-9287-3325f27ea3e7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:40.588863 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb617b5e-831c-4187-9287-3325f27ea3e7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:40.589219 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-eb617b5e-831c-4187-9287-3325f27ea3e7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:40.769737 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-eb617b5e-831c-4187-9287-3325f27ea3e7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:40.779903 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-eb617b5e-831c-4187-9287-3325f27ea3e7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:40.781309 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-eb617b5e-831c-4187-9287-3325f27ea3e7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:40.782699 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-eb617b5e-831c-4187-9287-3325f27ea3e7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.207990 Aug 24 11:36:40.783703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 497/1010] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:40 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:41.807045 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e04f6824-8613-4fe8-a991-96ea98d355f1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:41.808341 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e04f6824-8613-4fe8-a991-96ea98d355f1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:41.815211 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e04f6824-8613-4fe8-a991-96ea98d355f1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:41.815707 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e04f6824-8613-4fe8-a991-96ea98d355f1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:41.820402 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e04f6824-8613-4fe8-a991-96ea98d355f1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:41.820402 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e04f6824-8613-4fe8-a991-96ea98d355f1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:41.820402 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e04f6824-8613-4fe8-a991-96ea98d355f1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:41.820402 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e04f6824-8613-4fe8-a991-96ea98d355f1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:41.965067 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e04f6824-8613-4fe8-a991-96ea98d355f1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:41.980445 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e04f6824-8613-4fe8-a991-96ea98d355f1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:41.980445 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e04f6824-8613-4fe8-a991-96ea98d355f1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:41.980445 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e04f6824-8613-4fe8-a991-96ea98d355f1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.174606 Aug 24 11:36:41.980733 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 514/1011] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:41 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:42.078501 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-33340c4a-59e1-4ead-bfb5-4f0a4e2c9670 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:42.079059 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-33340c4a-59e1-4ead-bfb5-4f0a4e2c9670 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:42.087234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-33340c4a-59e1-4ead-bfb5-4f0a4e2c9670 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:42.089365 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-33340c4a-59e1-4ead-bfb5-4f0a4e2c9670 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:42.089365 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-33340c4a-59e1-4ead-bfb5-4f0a4e2c9670 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:42.089365 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-33340c4a-59e1-4ead-bfb5-4f0a4e2c9670 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:42.091037 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-33340c4a-59e1-4ead-bfb5-4f0a4e2c9670 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:42.091623 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-33340c4a-59e1-4ead-bfb5-4f0a4e2c9670 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:42.180458 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-33340c4a-59e1-4ead-bfb5-4f0a4e2c9670 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lazy-loading 'services' on Instance uuid 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:36:42.489474 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-33340c4a-59e1-4ead-bfb5-4f0a4e2c9670 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba/os-volume_attachments/f4988366-333e-419e-88fa-21ee2222df6c" status: 202 len: 0 microversion: 2.1 time: 0.415230 Aug 24 11:36:42.490100 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 498/1012] 10.222.0.83 () {58 vars in 1416 bytes} [Wed Aug 24 11:36:42 2022] DELETE /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba/os-volume_attachments/f4988366-333e-419e-88fa-21ee2222df6c => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:36:42.498746 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7eb5fb99-379d-4f99-8061-478919b6ed1d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:42.501181 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7eb5fb99-379d-4f99-8061-478919b6ed1d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:42.509366 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7eb5fb99-379d-4f99-8061-478919b6ed1d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:42.509861 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7eb5fb99-379d-4f99-8061-478919b6ed1d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:42.510581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7eb5fb99-379d-4f99-8061-478919b6ed1d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:42.511294 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7eb5fb99-379d-4f99-8061-478919b6ed1d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:42.511746 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7eb5fb99-379d-4f99-8061-478919b6ed1d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:42.513106 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7eb5fb99-379d-4f99-8061-478919b6ed1d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:42.545052 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7eb5fb99-379d-4f99-8061-478919b6ed1d tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050473 Aug 24 11:36:42.545628 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 515/1013] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:36:42 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:36:43.001417 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-45040efd-9c34-48ee-bcb7-fd6373d9d205 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:43.002041 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-45040efd-9c34-48ee-bcb7-fd6373d9d205 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:43.008999 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-45040efd-9c34-48ee-bcb7-fd6373d9d205 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:43.009490 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-45040efd-9c34-48ee-bcb7-fd6373d9d205 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:43.016617 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-45040efd-9c34-48ee-bcb7-fd6373d9d205 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:43.016617 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-45040efd-9c34-48ee-bcb7-fd6373d9d205 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:43.016617 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-45040efd-9c34-48ee-bcb7-fd6373d9d205 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:43.016617 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-45040efd-9c34-48ee-bcb7-fd6373d9d205 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:43.151386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-45040efd-9c34-48ee-bcb7-fd6373d9d205 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:43.153864 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:43.161395 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-45040efd-9c34-48ee-bcb7-fd6373d9d205 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:43.169976 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-45040efd-9c34-48ee-bcb7-fd6373d9d205 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:43.169976 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-45040efd-9c34-48ee-bcb7-fd6373d9d205 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.167254 Aug 24 11:36:43.169976 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 499/1014] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:42 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:43.557897 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-70cf8fc1-582f-4efc-b4fc-2ec621c2ac2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:43.560131 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-70cf8fc1-582f-4efc-b4fc-2ec621c2ac2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:43.567055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70cf8fc1-582f-4efc-b4fc-2ec621c2ac2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:43.567556 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70cf8fc1-582f-4efc-b4fc-2ec621c2ac2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:43.568202 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70cf8fc1-582f-4efc-b4fc-2ec621c2ac2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:43.568919 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70cf8fc1-582f-4efc-b4fc-2ec621c2ac2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:43.569373 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70cf8fc1-582f-4efc-b4fc-2ec621c2ac2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:43.569794 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70cf8fc1-582f-4efc-b4fc-2ec621c2ac2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:43.599816 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:43.605811 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-70cf8fc1-582f-4efc-b4fc-2ec621c2ac2c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052052 Aug 24 11:36:43.606813 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 516/1015] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:36:43 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:36:43.754910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-a84270e3-0dda-4683-aa4c-38bb555cf467 req-8c3ff382-281b-4943-b394-fbac42e814ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c6a206-49d7-44b6-a24f-f5961f099597", "name": "network-vif-plugged", "status": "completed", "tag": "dfa0d250-97f7-4d9a-9f1c-edee2d559865"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:36:43.766328 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-a84270e3-0dda-4683-aa4c-38bb555cf467 req-8c3ff382-281b-4943-b394-fbac42e814ba service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:43.766808 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-a84270e3-0dda-4683-aa4c-38bb555cf467 req-8c3ff382-281b-4943-b394-fbac42e814ba service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:43.767288 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-a84270e3-0dda-4683-aa4c-38bb555cf467 req-8c3ff382-281b-4943-b394-fbac42e814ba service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:43.778706 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-a84270e3-0dda-4683-aa4c-38bb555cf467 req-8c3ff382-281b-4943-b394-fbac42e814ba service nova] Creating event network-vif-plugged:dfa0d250-97f7-4d9a-9f1c-edee2d559865 for instance 17c6a206-49d7-44b6-a24f-f5961f099597 on hv-cinder-85427 Aug 24 11:36:43.783769 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-a84270e3-0dda-4683-aa4c-38bb555cf467 req-8c3ff382-281b-4943-b394-fbac42e814ba service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032669 Aug 24 11:36:43.784394 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 500/1016] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:36:44.188562 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e74d5426-1328-4b9c-ab74-7e9a109d9f7e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:44.189073 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e74d5426-1328-4b9c-ab74-7e9a109d9f7e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:44.195374 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e74d5426-1328-4b9c-ab74-7e9a109d9f7e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:44.195895 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e74d5426-1328-4b9c-ab74-7e9a109d9f7e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:44.196332 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e74d5426-1328-4b9c-ab74-7e9a109d9f7e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:44.197073 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e74d5426-1328-4b9c-ab74-7e9a109d9f7e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:44.197595 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e74d5426-1328-4b9c-ab74-7e9a109d9f7e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:44.198048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e74d5426-1328-4b9c-ab74-7e9a109d9f7e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:44.331456 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e74d5426-1328-4b9c-ab74-7e9a109d9f7e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:44.340736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e74d5426-1328-4b9c-ab74-7e9a109d9f7e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:44.342285 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e74d5426-1328-4b9c-ab74-7e9a109d9f7e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:44.343484 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e74d5426-1328-4b9c-ab74-7e9a109d9f7e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.159449 Aug 24 11:36:44.344055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 517/1017] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:44 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:44.618628 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1ea34107-5a3b-4c67-b60d-d2ed3ac4884f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:44.620905 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1ea34107-5a3b-4c67-b60d-d2ed3ac4884f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:44.627798 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1ea34107-5a3b-4c67-b60d-d2ed3ac4884f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:44.628287 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1ea34107-5a3b-4c67-b60d-d2ed3ac4884f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:44.630839 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1ea34107-5a3b-4c67-b60d-d2ed3ac4884f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:44.630839 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1ea34107-5a3b-4c67-b60d-d2ed3ac4884f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:44.630839 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1ea34107-5a3b-4c67-b60d-d2ed3ac4884f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:44.630839 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1ea34107-5a3b-4c67-b60d-d2ed3ac4884f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:44.660194 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1ea34107-5a3b-4c67-b60d-d2ed3ac4884f tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046315 Aug 24 11:36:44.660756 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 501/1018] 10.222.0.83 () {58 vars in 1302 bytes} [Wed Aug 24 11:36:44 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 11:36:44.728895 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-78cd21cf-aba7-4e62-86b2-9f78a5aee800 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:44.729404 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-78cd21cf-aba7-4e62-86b2-9f78a5aee800 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:44.735859 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78cd21cf-aba7-4e62-86b2-9f78a5aee800 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:44.736347 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78cd21cf-aba7-4e62-86b2-9f78a5aee800 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:44.736785 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78cd21cf-aba7-4e62-86b2-9f78a5aee800 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:44.737475 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78cd21cf-aba7-4e62-86b2-9f78a5aee800 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:44.737967 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78cd21cf-aba7-4e62-86b2-9f78a5aee800 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:44.738395 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78cd21cf-aba7-4e62-86b2-9f78a5aee800 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:44.765836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-78cd21cf-aba7-4e62-86b2-9f78a5aee800 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:36:45.044363 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-78cd21cf-aba7-4e62-86b2-9f78a5aee800 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 204 len: 0 microversion: 2.1 time: 0.319698 Aug 24 11:36:45.044994 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 518/1019] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:36:44 2022] DELETE /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:36:45.053587 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b969ba02-2684-4c03-a700-cf68a1f13cd2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:45.054233 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b969ba02-2684-4c03-a700-cf68a1f13cd2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:45.060479 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b969ba02-2684-4c03-a700-cf68a1f13cd2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:45.061567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b969ba02-2684-4c03-a700-cf68a1f13cd2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:45.062047 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b969ba02-2684-4c03-a700-cf68a1f13cd2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:45.062749 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b969ba02-2684-4c03-a700-cf68a1f13cd2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:45.063206 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b969ba02-2684-4c03-a700-cf68a1f13cd2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:45.063674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b969ba02-2684-4c03-a700-cf68a1f13cd2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:45.194426 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b969ba02-2684-4c03-a700-cf68a1f13cd2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:45.202849 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b969ba02-2684-4c03-a700-cf68a1f13cd2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1682 microversion: 2.1 time: 0.153454 Aug 24 11:36:45.203438 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 502/1020] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:45 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:45.367280 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2ddab93e-dd4c-4e44-ac27-accca0f04631 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:45.368486 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2ddab93e-dd4c-4e44-ac27-accca0f04631 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:45.374618 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ddab93e-dd4c-4e44-ac27-accca0f04631 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:45.375101 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ddab93e-dd4c-4e44-ac27-accca0f04631 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:45.375536 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ddab93e-dd4c-4e44-ac27-accca0f04631 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:45.376227 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ddab93e-dd4c-4e44-ac27-accca0f04631 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:45.376680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ddab93e-dd4c-4e44-ac27-accca0f04631 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:45.377100 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ddab93e-dd4c-4e44-ac27-accca0f04631 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:45.510821 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2ddab93e-dd4c-4e44-ac27-accca0f04631 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:45.519738 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2ddab93e-dd4c-4e44-ac27-accca0f04631 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:45.521248 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2ddab93e-dd4c-4e44-ac27-accca0f04631 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:45.522461 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2ddab93e-dd4c-4e44-ac27-accca0f04631 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.159545 Aug 24 11:36:45.523017 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 519/1021] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:45 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:46.224073 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-61b568d5-eb48-4a3b-b7b1-1b34364778f4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:46.224683 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-61b568d5-eb48-4a3b-b7b1-1b34364778f4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:46.231864 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-61b568d5-eb48-4a3b-b7b1-1b34364778f4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:46.232344 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-61b568d5-eb48-4a3b-b7b1-1b34364778f4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:46.232772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-61b568d5-eb48-4a3b-b7b1-1b34364778f4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:46.233450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-61b568d5-eb48-4a3b-b7b1-1b34364778f4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:46.233917 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-61b568d5-eb48-4a3b-b7b1-1b34364778f4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:46.234339 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-61b568d5-eb48-4a3b-b7b1-1b34364778f4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:46.364692 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-61b568d5-eb48-4a3b-b7b1-1b34364778f4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:46.373353 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-61b568d5-eb48-4a3b-b7b1-1b34364778f4 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1682 microversion: 2.1 time: 0.153336 Aug 24 11:36:46.373959 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 503/1022] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:46 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:46.553610 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5b27376f-f9df-46e1-a400-8942f30549fb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:46.553610 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5b27376f-f9df-46e1-a400-8942f30549fb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:46.554563 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b27376f-f9df-46e1-a400-8942f30549fb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:46.554563 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b27376f-f9df-46e1-a400-8942f30549fb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:46.555565 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b27376f-f9df-46e1-a400-8942f30549fb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:46.555952 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b27376f-f9df-46e1-a400-8942f30549fb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:46.556418 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b27376f-f9df-46e1-a400-8942f30549fb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:46.556840 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b27376f-f9df-46e1-a400-8942f30549fb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:46.688415 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5b27376f-f9df-46e1-a400-8942f30549fb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:46.697317 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5b27376f-f9df-46e1-a400-8942f30549fb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:46.698908 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5b27376f-f9df-46e1-a400-8942f30549fb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:46.700059 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5b27376f-f9df-46e1-a400-8942f30549fb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.157870 Aug 24 11:36:46.700622 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 520/1023] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:46 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:47.400125 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-331ca986-fd7d-4a48-bcf6-4c3eb92e1686 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:47.400812 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-331ca986-fd7d-4a48-bcf6-4c3eb92e1686 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:47.408722 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-331ca986-fd7d-4a48-bcf6-4c3eb92e1686 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:47.410578 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-331ca986-fd7d-4a48-bcf6-4c3eb92e1686 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:47.410578 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-331ca986-fd7d-4a48-bcf6-4c3eb92e1686 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:47.410578 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-331ca986-fd7d-4a48-bcf6-4c3eb92e1686 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:47.410868 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-331ca986-fd7d-4a48-bcf6-4c3eb92e1686 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:47.411275 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-331ca986-fd7d-4a48-bcf6-4c3eb92e1686 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:47.552382 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-331ca986-fd7d-4a48-bcf6-4c3eb92e1686 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:47.560835 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-331ca986-fd7d-4a48-bcf6-4c3eb92e1686 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1682 microversion: 2.1 time: 0.165687 Aug 24 11:36:47.561408 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 504/1024] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:47 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:47.724009 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fc3138cb-dc99-4bd8-b30b-9d50b9c8a47b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:47.724618 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fc3138cb-dc99-4bd8-b30b-9d50b9c8a47b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:47.731612 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc3138cb-dc99-4bd8-b30b-9d50b9c8a47b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:47.732091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc3138cb-dc99-4bd8-b30b-9d50b9c8a47b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:47.732522 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc3138cb-dc99-4bd8-b30b-9d50b9c8a47b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:47.733249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc3138cb-dc99-4bd8-b30b-9d50b9c8a47b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:47.733696 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc3138cb-dc99-4bd8-b30b-9d50b9c8a47b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:47.734152 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc3138cb-dc99-4bd8-b30b-9d50b9c8a47b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:47.864902 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fc3138cb-dc99-4bd8-b30b-9d50b9c8a47b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:47.874302 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fc3138cb-dc99-4bd8-b30b-9d50b9c8a47b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:47.875815 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fc3138cb-dc99-4bd8-b30b-9d50b9c8a47b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:47.876985 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fc3138cb-dc99-4bd8-b30b-9d50b9c8a47b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1809 microversion: 2.20 time: 0.156948 Aug 24 11:36:47.877540 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 521/1025] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:47 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:48.584302 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-bb39ddf8-faa4-400b-98e8-95840f3d8904 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:48.590364 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-bb39ddf8-faa4-400b-98e8-95840f3d8904 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:48.592945 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=34 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:36:48.594394 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb39ddf8-faa4-400b-98e8-95840f3d8904 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:48.594888 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb39ddf8-faa4-400b-98e8-95840f3d8904 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:48.596668 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb39ddf8-faa4-400b-98e8-95840f3d8904 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:48.597569 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb39ddf8-faa4-400b-98e8-95840f3d8904 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:48.598666 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb39ddf8-faa4-400b-98e8-95840f3d8904 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:48.599112 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb39ddf8-faa4-400b-98e8-95840f3d8904 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:48.676430 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-bb39ddf8-faa4-400b-98e8-95840f3d8904 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:48.684837 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-bb39ddf8-faa4-400b-98e8-95840f3d8904 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1614 microversion: 2.1 time: 0.104399 Aug 24 11:36:48.685707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 505/1026] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:48 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1614 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:48.901119 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d28a7720-5fac-48df-a69a-e4e363fd7a20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:48.901716 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d28a7720-5fac-48df-a69a-e4e363fd7a20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:48.908624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d28a7720-5fac-48df-a69a-e4e363fd7a20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:48.909373 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d28a7720-5fac-48df-a69a-e4e363fd7a20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:48.910339 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d28a7720-5fac-48df-a69a-e4e363fd7a20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:48.911448 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d28a7720-5fac-48df-a69a-e4e363fd7a20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:48.912931 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d28a7720-5fac-48df-a69a-e4e363fd7a20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:48.913593 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d28a7720-5fac-48df-a69a-e4e363fd7a20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:49.052640 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-8530202a-f7e8-436a-842f-cbd5ac0e81d3 req-e053a79e-a8cb-4410-81a1-58a6ed1c148a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228d2379-c4ae-4cf8-81bd-0fa2f4d418ba", "name": "network-vif-deleted", "tag": "4b482463-7461-41c3-860d-731d3f9a6c27"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:36:49.068418 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8530202a-f7e8-436a-842f-cbd5ac0e81d3 req-e053a79e-a8cb-4410-81a1-58a6ed1c148a service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:49.069138 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8530202a-f7e8-436a-842f-cbd5ac0e81d3 req-e053a79e-a8cb-4410-81a1-58a6ed1c148a service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:49.069915 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8530202a-f7e8-436a-842f-cbd5ac0e81d3 req-e053a79e-a8cb-4410-81a1-58a6ed1c148a service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:49.084655 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d28a7720-5fac-48df-a69a-e4e363fd7a20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:49.089865 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-8530202a-f7e8-436a-842f-cbd5ac0e81d3 req-e053a79e-a8cb-4410-81a1-58a6ed1c148a service nova] Creating event network-vif-deleted:4b482463-7461-41c3-860d-731d3f9a6c27 for instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba on hv-cinder-85427 Aug 24 11:36:49.093861 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d28a7720-5fac-48df-a69a-e4e363fd7a20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:49.095423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d28a7720-5fac-48df-a69a-e4e363fd7a20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:49.095897 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-8530202a-f7e8-436a-842f-cbd5ac0e81d3 req-e053a79e-a8cb-4410-81a1-58a6ed1c148a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243543 Aug 24 11:36:49.096796 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d28a7720-5fac-48df-a69a-e4e363fd7a20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1796 microversion: 2.20 time: 0.200495 Aug 24 11:36:49.097028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 522/1027] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:36:49.097788 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 506/1028] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:36:48 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1796 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:36:49.707468 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-79e219f8-23a2-42b1-9fd3-6631197993f2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:49.708200 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-79e219f8-23a2-42b1-9fd3-6631197993f2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:49.716778 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79e219f8-23a2-42b1-9fd3-6631197993f2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:49.717280 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79e219f8-23a2-42b1-9fd3-6631197993f2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:49.717717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79e219f8-23a2-42b1-9fd3-6631197993f2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:49.718455 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79e219f8-23a2-42b1-9fd3-6631197993f2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:49.718957 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79e219f8-23a2-42b1-9fd3-6631197993f2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:49.719379 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79e219f8-23a2-42b1-9fd3-6631197993f2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:49.761105 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79e219f8-23a2-42b1-9fd3-6631197993f2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:49.761601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79e219f8-23a2-42b1-9fd3-6631197993f2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:49.762088 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79e219f8-23a2-42b1-9fd3-6631197993f2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:49.762553 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-79e219f8-23a2-42b1-9fd3-6631197993f2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lazy-loading 'fault' on Instance uuid 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:36:49.805810 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-79e219f8-23a2-42b1-9fd3-6631197993f2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92712c36310c440c94da6c432c77a895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e41187605624091a4edc1993c4357e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:36:49.813689 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-79e219f8-23a2-42b1-9fd3-6631197993f2 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 200 len: 1331 microversion: 2.1 time: 0.110420 Aug 24 11:36:49.814303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 523/1029] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:49 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:36:50.835462 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-735e3b70-5b47-4a1d-8509-e31bb388e66b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:50.836288 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-735e3b70-5b47-4a1d-8509-e31bb388e66b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:50.842814 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-735e3b70-5b47-4a1d-8509-e31bb388e66b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:50.843334 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-735e3b70-5b47-4a1d-8509-e31bb388e66b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:50.843772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-735e3b70-5b47-4a1d-8509-e31bb388e66b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:50.844542 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-735e3b70-5b47-4a1d-8509-e31bb388e66b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:50.844984 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-735e3b70-5b47-4a1d-8509-e31bb388e66b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:50.845369 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-735e3b70-5b47-4a1d-8509-e31bb388e66b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:50.859740 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-735e3b70-5b47-4a1d-8509-e31bb388e66b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] HTTP exception thrown: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-735e3b70-5b47-4a1d-8509-e31bb388e66b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Request method failure captured: Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba HTTP/1.1 Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgqETgNFLZN-cxtSDRr_AFoOlwFhwLX-ENYaVxJIHruplC9b_hdqfdtCiKQ8e38a_s-rndXFIgCY0GxucbSuzC9p3nENX8PLFIsqMQamCWy7Yc0bmYX9_A7TAaleaFSwaJqPHdkBljR5oJSERsZWj2B6SSpAFNzgXV0qWmNYC4EPrM8 Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:36:50.861465 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:36:50.863167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6e41187605624091a4edc1993c4357e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6e41187605624091a4edc1993c4357e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:36:50.863167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:50.863167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:50.863167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:50.863167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:50.863167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:36:50.863167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:36:50.863167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 92712c36310c440c94da6c432c77a895 Aug 24 11:36:50.863167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:50.863167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:36:50.863167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:50.863167 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': '228d2379-c4ae-4cf8-81bd-0fa2f4d418ba'} Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:36:50.864162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:50.865707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:50.867893 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-735e3b70-5b47-4a1d-8509-e31bb388e66b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Returning 404 to user: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:36:50.867893 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-735e3b70-5b47-4a1d-8509-e31bb388e66b tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 404 len: 111 microversion: 2.1 time: 0.031518 Aug 24 11:36:50.867893 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 507/1030] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:50 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:36:50.872442 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ea27db50-6b6e-4d84-88e5-05a3a74f8b95 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '.version_select at 0x7f723da74940>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:51.028154 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ea27db50-6b6e-4d84-88e5-05a3a74f8b95 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2059875554" status: 202 len: 0 microversion: 2.1 time: 0.159405 Aug 24 11:36:51.028691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 524/1031] 10.222.0.83 () {58 vars in 1221 bytes} [Wed Aug 24 11:36:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2059875554 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:36:53.192613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6455943f-e38b-4a93-8c0e-bb2fa53facb1 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:53.193272 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6455943f-e38b-4a93-8c0e-bb2fa53facb1 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:53.200500 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6455943f-e38b-4a93-8c0e-bb2fa53facb1 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:53.200986 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6455943f-e38b-4a93-8c0e-bb2fa53facb1 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:53.201421 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6455943f-e38b-4a93-8c0e-bb2fa53facb1 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:53.202153 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6455943f-e38b-4a93-8c0e-bb2fa53facb1 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:53.202711 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6455943f-e38b-4a93-8c0e-bb2fa53facb1 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:53.203015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6455943f-e38b-4a93-8c0e-bb2fa53facb1 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:53.217757 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-6455943f-e38b-4a93-8c0e-bb2fa53facb1 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] HTTP exception thrown: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6455943f-e38b-4a93-8c0e-bb2fa53facb1 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Request method failure captured: Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: DELETE /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba HTTP/1.1 Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgqETgNFLZN-cxtSDRr_AFoOlwFhwLX-ENYaVxJIHruplC9b_hdqfdtCiKQ8e38a_s-rndXFIgCY0GxucbSuzC9p3nENX8PLFIsqMQamCWy7Yc0bmYX9_A7TAaleaFSwaJqPHdkBljR5oJSERsZWj2B6SSpAFNzgXV0qWmNYC4EPrM8 Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:36:53.219624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:36:53.221225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6e41187605624091a4edc1993c4357e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6e41187605624091a4edc1993c4357e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:36:53.221225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:53.221225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:53.221225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:53.221225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:53.221225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:36:53.221225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:36:53.221225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 92712c36310c440c94da6c432c77a895 Aug 24 11:36:53.221225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:53.221225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:36:53.221225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:53.221225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': '228d2379-c4ae-4cf8-81bd-0fa2f4d418ba'} Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:36:53.222270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:53.223450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:53.225063 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6455943f-e38b-4a93-8c0e-bb2fa53facb1 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Returning 404 to user: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:36:53.225063 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6455943f-e38b-4a93-8c0e-bb2fa53facb1 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 404 len: 111 microversion: 2.1 time: 0.032340 Aug 24 11:36:53.225063 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 508/1032] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:36:53 2022] DELETE /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:36:53.231128 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fd713613-6909-4a61-905c-192c39c40995 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:53.231826 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fd713613-6909-4a61-905c-192c39c40995 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:53.238757 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd713613-6909-4a61-905c-192c39c40995 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:53.239248 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd713613-6909-4a61-905c-192c39c40995 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:53.239686 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd713613-6909-4a61-905c-192c39c40995 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:53.240387 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd713613-6909-4a61-905c-192c39c40995 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:53.240842 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd713613-6909-4a61-905c-192c39c40995 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:53.241266 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fd713613-6909-4a61-905c-192c39c40995 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:53.256926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-fd713613-6909-4a61-905c-192c39c40995 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] HTTP exception thrown: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fd713613-6909-4a61-905c-192c39c40995 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Request method failure captured: Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba HTTP/1.1 Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgqETgNFLZN-cxtSDRr_AFoOlwFhwLX-ENYaVxJIHruplC9b_hdqfdtCiKQ8e38a_s-rndXFIgCY0GxucbSuzC9p3nENX8PLFIsqMQamCWy7Yc0bmYX9_A7TAaleaFSwaJqPHdkBljR5oJSERsZWj2B6SSpAFNzgXV0qWmNYC4EPrM8 Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:36:53.259135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:36:53.260926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6e41187605624091a4edc1993c4357e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6e41187605624091a4edc1993c4357e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:36:53.260926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:53.260926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:53.260926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:53.260926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:53.260926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:36:53.260926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:36:53.260926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 92712c36310c440c94da6c432c77a895 Aug 24 11:36:53.260926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:53.260926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:36:53.260926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:53.260926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '228d2379-c4ae-4cf8-81bd-0fa2f4d418ba'} Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:36:53.261748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. Aug 24 11:36:53.263029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:53.264102 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fd713613-6909-4a61-905c-192c39c40995 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Returning 404 to user: Instance 228d2379-c4ae-4cf8-81bd-0fa2f4d418ba could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:36:53.264102 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fd713613-6909-4a61-905c-192c39c40995 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba" status: 404 len: 111 microversion: 2.1 time: 0.034361 Aug 24 11:36:53.264102 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 525/1033] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:53 2022] GET /compute/v2.1/servers/228d2379-c4ae-4cf8-81bd-0fa2f4d418ba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:36:54.653600 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0e87b813-8f81-4be1-96e0-24d510365cec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:54.654121 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0e87b813-8f81-4be1-96e0-24d510365cec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:54.660500 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0e87b813-8f81-4be1-96e0-24d510365cec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:54.660976 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0e87b813-8f81-4be1-96e0-24d510365cec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:54.661404 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0e87b813-8f81-4be1-96e0-24d510365cec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:54.662108 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0e87b813-8f81-4be1-96e0-24d510365cec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:54.662555 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0e87b813-8f81-4be1-96e0-24d510365cec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:54.662969 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0e87b813-8f81-4be1-96e0-24d510365cec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:54.677092 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-0e87b813-8f81-4be1-96e0-24d510365cec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] HTTP exception thrown: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0e87b813-8f81-4be1-96e0-24d510365cec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Request method failure captured: Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: DELETE /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 HTTP/1.1 Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgqETgNFLZN-cxtSDRr_AFoOlwFhwLX-ENYaVxJIHruplC9b_hdqfdtCiKQ8e38a_s-rndXFIgCY0GxucbSuzC9p3nENX8PLFIsqMQamCWy7Yc0bmYX9_A7TAaleaFSwaJqPHdkBljR5oJSERsZWj2B6SSpAFNzgXV0qWmNYC4EPrM8 Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:36:54.678819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:36:54.680258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6e41187605624091a4edc1993c4357e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6e41187605624091a4edc1993c4357e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:36:54.680258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:54.680258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:54.680258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:54.680258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:54.680258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:36:54.680258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:36:54.680258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 92712c36310c440c94da6c432c77a895 Aug 24 11:36:54.680258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:54.680258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:36:54.680258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:36:54.680258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': '9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2'} Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:36:54.681080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:36:54.682424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.683745 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0e87b813-8f81-4be1-96e0-24d510365cec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Returning 404 to user: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:36:54.683745 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0e87b813-8f81-4be1-96e0-24d510365cec tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 404 len: 111 microversion: 2.1 time: 0.030699 Aug 24 11:36:54.683745 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 509/1034] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:36:54 2022] DELETE /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:36:54.689190 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8cd061e9-d61f-42b8-a02a-90b56867c020 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:54.689816 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8cd061e9-d61f-42b8-a02a-90b56867c020 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:54.696793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cd061e9-d61f-42b8-a02a-90b56867c020 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:54.697289 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cd061e9-d61f-42b8-a02a-90b56867c020 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:54.697731 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cd061e9-d61f-42b8-a02a-90b56867c020 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:54.698456 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cd061e9-d61f-42b8-a02a-90b56867c020 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:54.698913 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cd061e9-d61f-42b8-a02a-90b56867c020 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:54.699337 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cd061e9-d61f-42b8-a02a-90b56867c020 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:54.714071 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-8cd061e9-d61f-42b8-a02a-90b56867c020 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] HTTP exception thrown: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8cd061e9-d61f-42b8-a02a-90b56867c020 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Request method failure captured: Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 HTTP/1.1 Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgqETgNFLZN-cxtSDRr_AFoOlwFhwLX-ENYaVxJIHruplC9b_hdqfdtCiKQ8e38a_s-rndXFIgCY0GxucbSuzC9p3nENX8PLFIsqMQamCWy7Yc0bmYX9_A7TAaleaFSwaJqPHdkBljR5oJSERsZWj2B6SSpAFNzgXV0qWmNYC4EPrM8 Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:36:54.715643 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:36:54.717406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6e41187605624091a4edc1993c4357e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6e41187605624091a4edc1993c4357e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:36:54.717406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:54.717406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:54.717406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:54.717406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:54.717406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:36:54.717406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:36:54.717406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 92712c36310c440c94da6c432c77a895 Aug 24 11:36:54.717406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:54.717406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:36:54.717406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:36:54.717406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2'} Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:36:54.718325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. Aug 24 11:36:54.719802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.721086 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8cd061e9-d61f-42b8-a02a-90b56867c020 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Returning 404 to user: Instance 9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:36:54.721086 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8cd061e9-d61f-42b8-a02a-90b56867c020 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2" status: 404 len: 111 microversion: 2.1 time: 0.031859 Aug 24 11:36:54.721086 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 526/1035] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:54 2022] GET /compute/v2.1/servers/9ecdf40f-79f2-46ed-b10a-b5ffda8f0cc2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:36:54.725830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ec863c53-13db-4129-b4c1-6b3b60b34bf0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:54.726352 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ec863c53-13db-4129-b4c1-6b3b60b34bf0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:54.732514 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ec863c53-13db-4129-b4c1-6b3b60b34bf0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:54.732995 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ec863c53-13db-4129-b4c1-6b3b60b34bf0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:54.733433 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ec863c53-13db-4129-b4c1-6b3b60b34bf0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:54.734187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ec863c53-13db-4129-b4c1-6b3b60b34bf0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:54.734647 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ec863c53-13db-4129-b4c1-6b3b60b34bf0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:54.735069 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ec863c53-13db-4129-b4c1-6b3b60b34bf0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:54.752806 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-ec863c53-13db-4129-b4c1-6b3b60b34bf0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] HTTP exception thrown: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ec863c53-13db-4129-b4c1-6b3b60b34bf0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Request method failure captured: Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: DELETE /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 HTTP/1.1 Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgqETgNFLZN-cxtSDRr_AFoOlwFhwLX-ENYaVxJIHruplC9b_hdqfdtCiKQ8e38a_s-rndXFIgCY0GxucbSuzC9p3nENX8PLFIsqMQamCWy7Yc0bmYX9_A7TAaleaFSwaJqPHdkBljR5oJSERsZWj2B6SSpAFNzgXV0qWmNYC4EPrM8 Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:36:54.754405 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:36:54.756022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6e41187605624091a4edc1993c4357e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6e41187605624091a4edc1993c4357e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:36:54.756022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:54.756022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:54.756022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:54.756022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:54.756022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:36:54.756022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:36:54.756022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 92712c36310c440c94da6c432c77a895 Aug 24 11:36:54.756022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:54.756022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:36:54.756022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:36:54.756022 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': '52c2009e-3a3a-4e95-a967-0275cb1fe2b7'} Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:36:54.756941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:36:54.759211 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.761052 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ec863c53-13db-4129-b4c1-6b3b60b34bf0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Returning 404 to user: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:36:54.761052 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ec863c53-13db-4129-b4c1-6b3b60b34bf0 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 404 len: 111 microversion: 2.1 time: 0.033932 Aug 24 11:36:54.761052 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 510/1036] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:36:54 2022] DELETE /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:36:54.765313 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-607c2f2b-175d-4d0f-862c-6e1f93e8c09c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:54.765959 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-607c2f2b-175d-4d0f-862c-6e1f93e8c09c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 52c2009e-3a3a-4e95-a967-0275cb1fe2b7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:54.771970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-607c2f2b-175d-4d0f-862c-6e1f93e8c09c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:54.772454 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-607c2f2b-175d-4d0f-862c-6e1f93e8c09c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:54.772890 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-607c2f2b-175d-4d0f-862c-6e1f93e8c09c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:54.774212 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-607c2f2b-175d-4d0f-862c-6e1f93e8c09c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:54.774674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-607c2f2b-175d-4d0f-862c-6e1f93e8c09c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:54.775101 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-607c2f2b-175d-4d0f-862c-6e1f93e8c09c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:54.789095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-607c2f2b-175d-4d0f-862c-6e1f93e8c09c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] HTTP exception thrown: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-607c2f2b-175d-4d0f-862c-6e1f93e8c09c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Request method failure captured: Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 HTTP/1.1 Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgqETgNFLZN-cxtSDRr_AFoOlwFhwLX-ENYaVxJIHruplC9b_hdqfdtCiKQ8e38a_s-rndXFIgCY0GxucbSuzC9p3nENX8PLFIsqMQamCWy7Yc0bmYX9_A7TAaleaFSwaJqPHdkBljR5oJSERsZWj2B6SSpAFNzgXV0qWmNYC4EPrM8 Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:36:54.790664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:36:54.792224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6e41187605624091a4edc1993c4357e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6e41187605624091a4edc1993c4357e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:36:54.792224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:54.792224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:54.792224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:54.792224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:54.792224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:36:54.792224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:36:54.792224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 92712c36310c440c94da6c432c77a895 Aug 24 11:36:54.792224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:54.792224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:36:54.792224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:36:54.792224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '52c2009e-3a3a-4e95-a967-0275cb1fe2b7'} Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:36:54.793049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. Aug 24 11:36:54.794301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:54.795595 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-607c2f2b-175d-4d0f-862c-6e1f93e8c09c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Returning 404 to user: Instance 52c2009e-3a3a-4e95-a967-0275cb1fe2b7 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:36:54.795595 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-607c2f2b-175d-4d0f-862c-6e1f93e8c09c tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7" status: 404 len: 111 microversion: 2.1 time: 0.030694 Aug 24 11:36:54.795595 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 527/1037] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:54 2022] GET /compute/v2.1/servers/52c2009e-3a3a-4e95-a967-0275cb1fe2b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:36:56.189984 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b12f0225-04d6-4e83-bc02-7649dd122ae9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:56.190535 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b12f0225-04d6-4e83-bc02-7649dd122ae9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:56.197661 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b12f0225-04d6-4e83-bc02-7649dd122ae9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:56.198144 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b12f0225-04d6-4e83-bc02-7649dd122ae9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:56.198569 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b12f0225-04d6-4e83-bc02-7649dd122ae9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:56.199337 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b12f0225-04d6-4e83-bc02-7649dd122ae9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:56.199786 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b12f0225-04d6-4e83-bc02-7649dd122ae9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:56.200267 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b12f0225-04d6-4e83-bc02-7649dd122ae9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:56.215075 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-b12f0225-04d6-4e83-bc02-7649dd122ae9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] HTTP exception thrown: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b12f0225-04d6-4e83-bc02-7649dd122ae9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Request method failure captured: Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: DELETE /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 HTTP/1.1 Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgqETgNFLZN-cxtSDRr_AFoOlwFhwLX-ENYaVxJIHruplC9b_hdqfdtCiKQ8e38a_s-rndXFIgCY0GxucbSuzC9p3nENX8PLFIsqMQamCWy7Yc0bmYX9_A7TAaleaFSwaJqPHdkBljR5oJSERsZWj2B6SSpAFNzgXV0qWmNYC4EPrM8 Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:36:56.216613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:36:56.218231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6e41187605624091a4edc1993c4357e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6e41187605624091a4edc1993c4357e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:36:56.218231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:56.218231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:56.218231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:56.218231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:56.218231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:36:56.218231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:36:56.218231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 92712c36310c440c94da6c432c77a895 Aug 24 11:36:56.218231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:56.218231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:36:56.218231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:36:56.218231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': '855ac5ba-541c-4dc9-8a34-122679948e06'} Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:36:56.219187 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:36:56.220679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:36:56.222312 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b12f0225-04d6-4e83-bc02-7649dd122ae9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Returning 404 to user: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:36:56.222312 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b12f0225-04d6-4e83-bc02-7649dd122ae9 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "DELETE /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 404 len: 111 microversion: 2.1 time: 0.032051 Aug 24 11:36:56.222312 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 511/1038] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:36:56 2022] DELETE /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:36:56.227091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5f53ab9a-4ea3-40bd-b018-4e7fe88deb49 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:36:56.227707 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5f53ab9a-4ea3-40bd-b018-4e7fe88deb49 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] [instance: 855ac5ba-541c-4dc9-8a34-122679948e06] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:36:56.234180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f53ab9a-4ea3-40bd-b018-4e7fe88deb49 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:56.234663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f53ab9a-4ea3-40bd-b018-4e7fe88deb49 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:56.235097 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f53ab9a-4ea3-40bd-b018-4e7fe88deb49 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:56.235788 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f53ab9a-4ea3-40bd-b018-4e7fe88deb49 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:36:56.236238 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f53ab9a-4ea3-40bd-b018-4e7fe88deb49 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:36:56.236657 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f53ab9a-4ea3-40bd-b018-4e7fe88deb49 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:36:56.249979 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-5f53ab9a-4ea3-40bd-b018-4e7fe88deb49 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] HTTP exception thrown: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5f53ab9a-4ea3-40bd-b018-4e7fe88deb49 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Request method failure captured: Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 HTTP/1.1 Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgqETgNFLZN-cxtSDRr_AFoOlwFhwLX-ENYaVxJIHruplC9b_hdqfdtCiKQ8e38a_s-rndXFIgCY0GxucbSuzC9p3nENX8PLFIsqMQamCWy7Yc0bmYX9_A7TAaleaFSwaJqPHdkBljR5oJSERsZWj2B6SSpAFNzgXV0qWmNYC4EPrM8 Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:36:56.251505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:36:56.253095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6e41187605624091a4edc1993c4357e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6e41187605624091a4edc1993c4357e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6e41187605624091a4edc1993c4357e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:36:56.253095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:56.253095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 6e41187605624091a4edc1993c4357e4 Aug 24 11:36:56.253095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1954107343 Aug 24 11:36:56.253095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:56.253095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:36:56.253095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:36:56.253095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 92712c36310c440c94da6c432c77a895 Aug 24 11:36:56.253095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-1954107343-project Aug 24 11:36:56.253095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:36:56.253095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:36:56.253095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '855ac5ba-541c-4dc9-8a34-122679948e06'} Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:36:56.254013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. Aug 24 11:36:56.255570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:36:56.256850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5f53ab9a-4ea3-40bd-b018-4e7fe88deb49 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] Returning 404 to user: Instance 855ac5ba-541c-4dc9-8a34-122679948e06 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:36:56.256850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5f53ab9a-4ea3-40bd-b018-4e7fe88deb49 tempest-AttachVolumeNegativeTest-1954107343 tempest-AttachVolumeNegativeTest-1954107343-project] 10.222.0.83 "GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06" status: 404 len: 111 microversion: 2.1 time: 0.029631 Aug 24 11:36:56.256850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 528/1039] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:36:56 2022] GET /compute/v2.1/servers/855ac5ba-541c-4dc9-8a34-122679948e06 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:37:02.779883 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8f30c4ea-aa6c-4912-806c-039bdaa5c878 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Action: 'create', calling method: .version_select at 0x7f723d0c88b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1467197161", "metadata": {"Type": "work"}}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8f30c4ea-aa6c-4912-806c-039bdaa5c878 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Request method failure captured: Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 122 Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBg1em6FnOPYfMLDfhF-3ZB2lNO1W9ydjDT4uUTOCOuw6-cGLuQksMj1bH_FHS1hK3zv7K092dG4-X6ZnPOLxGQwkjBeEUJWTsGsMl5OJiyrr9ypOjtMaHE1kLYYGuDH3gP6oL5A_LXIip5lgBnNuov-rzgKAh53KLcJBSAOO75CZwyI Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: a4d2c15301d44e92b86d7a19347de166 Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:37:02.796606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:37:02.798065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a4d2c15301d44e92b86d7a19347de166", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:37:02.798065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.798065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: a4d2c15301d44e92b86d7a19347de166 Aug 24 11:37:02.798065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.798065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-VolumesNegativeTest-1420256559-project Aug 24 11:37:02.798065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:37:02.798065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:37:02.798065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 77b31c0002ba4ef69c6cb860dbf6dfcc Aug 24 11:37:02.798065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-VolumesNegativeTest-1420256559-project Aug 24 11:37:02.798065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Aug 24 11:37:02.798065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1467197161", "metadata": {"Type": "work"}}} Aug 24 11:37:02.798065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: Aug 24 11:37:02.798065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1467197161', 'metadata': {'Type': 'work'}}}} Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise error Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:37:02.799629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 11:37:02.801141 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 11:37:02.802517 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 11:37:02.802517 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.802517 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8f30c4ea-aa6c-4912-806c-039bdaa5c878 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:37:02.802517 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8f30c4ea-aa6c-4912-806c-039bdaa5c878 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131969 Aug 24 11:37:02.802517 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 512/1040] 10.222.0.83 () {60 vars in 1156 bytes} [Wed Aug 24 11:37:02 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:37:02.809538 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-92d77559-cd0c-48ce-a686-77b7673995e8 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Action: 'create', calling method: .version_select at 0x7f723d859ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1256781990", "metadata": {"Type": "work"}}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-92d77559-cd0c-48ce-a686-77b7673995e8 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Request method failure captured: Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 120 Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBg1em6FnOPYfMLDfhF-3ZB2lNO1W9ydjDT4uUTOCOuw6-cGLuQksMj1bH_FHS1hK3zv7K092dG4-X6ZnPOLxGQwkjBeEUJWTsGsMl5OJiyrr9ypOjtMaHE1kLYYGuDH3gP6oL5A_LXIip5lgBnNuov-rzgKAh53KLcJBSAOO75CZwyI Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: a4d2c15301d44e92b86d7a19347de166 Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:37:02.814245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:37:02.815942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a4d2c15301d44e92b86d7a19347de166", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:37:02.815942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.815942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: a4d2c15301d44e92b86d7a19347de166 Aug 24 11:37:02.815942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.815942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesNegativeTest-1420256559-project Aug 24 11:37:02.815942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:37:02.815942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:37:02.815942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 77b31c0002ba4ef69c6cb860dbf6dfcc Aug 24 11:37:02.815942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesNegativeTest-1420256559-project Aug 24 11:37:02.815942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Aug 24 11:37:02.815942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1256781990", "metadata": {"Type": "work"}}} Aug 24 11:37:02.815942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: Aug 24 11:37:02.815942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1256781990', 'metadata': {'Type': 'work'}}}} Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise error Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi '0' Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:37:02.816891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 11:37:02.818774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 11:37:02.820298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 11:37:02.820298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.820298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-92d77559-cd0c-48ce-a686-77b7673995e8 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:37:02.820298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-92d77559-cd0c-48ce-a686-77b7673995e8 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010110 Aug 24 11:37:02.820298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 529/1041] 10.222.0.83 () {60 vars in 1156 bytes} [Wed Aug 24 11:37:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:37:02.825604 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e6b88c3a-dea1-4394-8ed1-ba8f371ebca6 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Action: 'create', calling method: .version_select at 0x7f723ce24b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1964837850", "metadata": {"Type": "work"}}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e6b88c3a-dea1-4394-8ed1-ba8f371ebca6 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Request method failure captured: Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 119 Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBg1em6FnOPYfMLDfhF-3ZB2lNO1W9ydjDT4uUTOCOuw6-cGLuQksMj1bH_FHS1hK3zv7K092dG4-X6ZnPOLxGQwkjBeEUJWTsGsMl5OJiyrr9ypOjtMaHE1kLYYGuDH3gP6oL5A_LXIip5lgBnNuov-rzgKAh53KLcJBSAOO75CZwyI Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: a4d2c15301d44e92b86d7a19347de166 Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:37:02.830227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:37:02.835015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a4d2c15301d44e92b86d7a19347de166", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:37:02.835015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.835015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: a4d2c15301d44e92b86d7a19347de166 Aug 24 11:37:02.835015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.835015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-VolumesNegativeTest-1420256559-project Aug 24 11:37:02.835015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:37:02.835015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:37:02.835015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 77b31c0002ba4ef69c6cb860dbf6dfcc Aug 24 11:37:02.835015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-VolumesNegativeTest-1420256559-project Aug 24 11:37:02.835015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Aug 24 11:37:02.835015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1964837850", "metadata": {"Type": "work"}}} Aug 24 11:37:02.835015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: Aug 24 11:37:02.835015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1964837850', 'metadata': {'Type': 'work'}}}} Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise error Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi '' Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:37:02.836036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 11:37:02.837695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 11:37:02.839152 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 11:37:02.839152 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.839152 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e6b88c3a-dea1-4394-8ed1-ba8f371ebca6 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:37:02.839152 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e6b88c3a-dea1-4394-8ed1-ba8f371ebca6 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009861 Aug 24 11:37:02.839152 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 513/1042] 10.222.0.83 () {60 vars in 1156 bytes} [Wed Aug 24 11:37:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:37:02.841386 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-57da7fcd-91a1-4299-86ba-87082451d8b3 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Calling method '.version_select at 0x7f724209c1f0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-57da7fcd-91a1-4299-86ba-87082451d8b3 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] HTTP exception thrown: Volume tempest-invalid-250485280 could not be found. Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-57da7fcd-91a1-4299-86ba-87082451d8b3 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Request method failure captured: Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-250485280 HTTP/1.1 Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBg1em6FnOPYfMLDfhF-3ZB2lNO1W9ydjDT4uUTOCOuw6-cGLuQksMj1bH_FHS1hK3zv7K092dG4-X6ZnPOLxGQwkjBeEUJWTsGsMl5OJiyrr9ypOjtMaHE1kLYYGuDH3gP6oL5A_LXIip5lgBnNuov-rzgKAh53KLcJBSAOO75CZwyI Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: a4d2c15301d44e92b86d7a19347de166 Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:37:02.878787 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:37:02.880303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a4d2c15301d44e92b86d7a19347de166", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:37:02.880303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.880303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: a4d2c15301d44e92b86d7a19347de166 Aug 24 11:37:02.880303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.880303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesNegativeTest-1420256559-project Aug 24 11:37:02.880303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:37:02.880303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:37:02.880303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 77b31c0002ba4ef69c6cb860dbf6dfcc Aug 24 11:37:02.880303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesNegativeTest-1420256559-project Aug 24 11:37:02.880303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: Aug 24 11:37:02.880303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Volume tempest-invalid-250485280 could not be found. Aug 24 11:37:02.880303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': 'tempest-invalid-250485280'} Aug 24 11:37:02.880303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-250485280 could not be found. (HTTP 404) (Request-ID: req-fde36946-87bc-4b78-b00a-56e9cb77c20f) Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.881352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:37:02.883446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-250485280 could not be found. Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:37:02.885163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-250485280 could not be found. Aug 24 11:37:02.886758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.886758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.886758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.886758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.886758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:02.886758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:02.886758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:37:02.886758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:37:02.886758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-250485280 could not be found. Aug 24 11:37:02.886758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.886758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-57da7fcd-91a1-4299-86ba-87082451d8b3 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Returning 404 to user: Volume tempest-invalid-250485280 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:37:02.886758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-57da7fcd-91a1-4299-86ba-87082451d8b3 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/tempest-invalid-250485280" status: 404 len: 98 microversion: 2.1 time: 0.037352 Aug 24 11:37:02.886758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 530/1043] 10.222.0.83 () {58 vars in 1215 bytes} [Wed Aug 24 11:37:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-250485280 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 11:37:02.887765 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f6203326-65bc-476c-9125-8ba710ee6424 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004551 Aug 24 11:37:02.887868 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 514/1044] 10.222.0.83 () {58 vars in 1140 bytes} [Wed Aug 24 11:37:02 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 11:37:02.896483 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cefbf5e9-f24c-468c-908c-6a9320563fe3 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003864 Aug 24 11:37:02.896982 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 531/1045] 10.222.0.83 () {58 vars in 1137 bytes} [Wed Aug 24 11:37:02 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 11:37:02.905951 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-50fe8bc4-43dc-4e50-bbb9-f1855ab1f3a5 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Calling method '.version_select at 0x7f723d1bc9d0>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:02.933245 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-50fe8bc4-43dc-4e50-bbb9-f1855ab1f3a5 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] HTTP exception thrown: Volume 7b11f1c6-191b-48e8-a8f0-0a88953843b0 could not be found. Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-50fe8bc4-43dc-4e50-bbb9-f1855ab1f3a5 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Request method failure captured: Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: DELETE /compute/v2.1/os-volumes/7b11f1c6-191b-48e8-a8f0-0a88953843b0 HTTP/1.1 Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBg1em6FnOPYfMLDfhF-3ZB2lNO1W9ydjDT4uUTOCOuw6-cGLuQksMj1bH_FHS1hK3zv7K092dG4-X6ZnPOLxGQwkjBeEUJWTsGsMl5OJiyrr9ypOjtMaHE1kLYYGuDH3gP6oL5A_LXIip5lgBnNuov-rzgKAh53KLcJBSAOO75CZwyI Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: a4d2c15301d44e92b86d7a19347de166 Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:37:02.935231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:37:02.937376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a4d2c15301d44e92b86d7a19347de166", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:37:02.937376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.937376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: a4d2c15301d44e92b86d7a19347de166 Aug 24 11:37:02.937376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.937376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-VolumesNegativeTest-1420256559-project Aug 24 11:37:02.937376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:37:02.937376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:37:02.937376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 77b31c0002ba4ef69c6cb860dbf6dfcc Aug 24 11:37:02.937376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-VolumesNegativeTest-1420256559-project Aug 24 11:37:02.937376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: Aug 24 11:37:02.937376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Volume 7b11f1c6-191b-48e8-a8f0-0a88953843b0 could not be found. Aug 24 11:37:02.937376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': '7b11f1c6-191b-48e8-a8f0-0a88953843b0'} Aug 24 11:37:02.937376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b11f1c6-191b-48e8-a8f0-0a88953843b0 could not be found. (HTTP 404) (Request-ID: req-248a3bb5-c466-46a7-81d1-180a0565e902) Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.938442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 11:37:02.939807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b11f1c6-191b-48e8-a8f0-0a88953843b0 could not be found. Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 11:37:02.941314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:37:02.942802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b11f1c6-191b-48e8-a8f0-0a88953843b0 could not be found. Aug 24 11:37:02.942802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.942802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.942802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.942802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.942802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:02.942802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:02.942802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:37:02.942802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:37:02.942802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b11f1c6-191b-48e8-a8f0-0a88953843b0 could not be found. Aug 24 11:37:02.942802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.942802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-50fe8bc4-43dc-4e50-bbb9-f1855ab1f3a5 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Returning 404 to user: Volume 7b11f1c6-191b-48e8-a8f0-0a88953843b0 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:37:02.942802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-50fe8bc4-43dc-4e50-bbb9-f1855ab1f3a5 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/7b11f1c6-191b-48e8-a8f0-0a88953843b0" status: 404 len: 109 microversion: 2.1 time: 0.034361 Aug 24 11:37:02.942802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 515/1046] 10.222.0.83 () {58 vars in 1248 bytes} [Wed Aug 24 11:37:02 2022] DELETE /compute/v2.1/os-volumes/7b11f1c6-191b-48e8-a8f0-0a88953843b0 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:37:02.946932 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a211deca-349a-49eb-ae6e-c173cc697556 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Calling method '.version_select at 0x7f723d8c9700>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-a211deca-349a-49eb-ae6e-c173cc697556 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] HTTP exception thrown: Volume 4f094a3b-4c0c-41ed-a0a8-13c5500a0b13 could not be found. Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a211deca-349a-49eb-ae6e-c173cc697556 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Request method failure captured: Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/os-volumes/4f094a3b-4c0c-41ed-a0a8-13c5500a0b13 HTTP/1.1 Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBg1em6FnOPYfMLDfhF-3ZB2lNO1W9ydjDT4uUTOCOuw6-cGLuQksMj1bH_FHS1hK3zv7K092dG4-X6ZnPOLxGQwkjBeEUJWTsGsMl5OJiyrr9ypOjtMaHE1kLYYGuDH3gP6oL5A_LXIip5lgBnNuov-rzgKAh53KLcJBSAOO75CZwyI Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: a4d2c15301d44e92b86d7a19347de166 Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:37:02.981005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:37:02.983046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a4d2c15301d44e92b86d7a19347de166", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a4d2c15301d44e92b86d7a19347de166"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:37:02.983046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.983046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: a4d2c15301d44e92b86d7a19347de166 Aug 24 11:37:02.983046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesNegativeTest-1420256559 Aug 24 11:37:02.983046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesNegativeTest-1420256559-project Aug 24 11:37:02.983046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:37:02.983046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:37:02.983046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 77b31c0002ba4ef69c6cb860dbf6dfcc Aug 24 11:37:02.983046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesNegativeTest-1420256559-project Aug 24 11:37:02.983046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: Aug 24 11:37:02.983046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Volume 4f094a3b-4c0c-41ed-a0a8-13c5500a0b13 could not be found. Aug 24 11:37:02.983046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '4f094a3b-4c0c-41ed-a0a8-13c5500a0b13'} Aug 24 11:37:02.983046 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f094a3b-4c0c-41ed-a0a8-13c5500a0b13 could not be found. (HTTP 404) (Request-ID: req-2dce58f1-6e25-4ad1-b0c9-3b086c91f028) Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.984180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 11:37:02.985645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f094a3b-4c0c-41ed-a0a8-13c5500a0b13 could not be found. Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 11:37:02.987134 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:37:02.988680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f094a3b-4c0c-41ed-a0a8-13c5500a0b13 could not be found. Aug 24 11:37:02.988680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.988680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:02.988680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.988680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:02.988680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:02.988680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:02.988680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:37:02.988680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:37:02.988680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f094a3b-4c0c-41ed-a0a8-13c5500a0b13 could not be found. Aug 24 11:37:02.988680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:02.988680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a211deca-349a-49eb-ae6e-c173cc697556 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] Returning 404 to user: Volume 4f094a3b-4c0c-41ed-a0a8-13c5500a0b13 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:37:02.988680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a211deca-349a-49eb-ae6e-c173cc697556 tempest-VolumesNegativeTest-1420256559 tempest-VolumesNegativeTest-1420256559-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/4f094a3b-4c0c-41ed-a0a8-13c5500a0b13" status: 404 len: 109 microversion: 2.1 time: 0.035278 Aug 24 11:37:02.988680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 532/1047] 10.222.0.83 () {58 vars in 1245 bytes} [Wed Aug 24 11:37:02 2022] GET /compute/v2.1/os-volumes/4f094a3b-4c0c-41ed-a0a8-13c5500a0b13 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:37:03.988324 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-481814128", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452"}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:04.041044 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] validate_networks() for None {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:37:04.322713 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:37:04.322713 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:37:04.322713 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:37:04.322713 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:37:04.322713 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:37:04.331439 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:04.331918 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:04.332347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:04.333091 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:04.333543 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:04.333989 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:04.351823 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Getting quotas for project b4d27b24d8e5430c93890088fb6386db. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:37:04.355754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Getting quotas for user effc45029842477e92552609037f2e35 and project b4d27b24d8e5430c93890088fb6386db. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:37:04.366493 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:37:04.371242 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:37:04.531092 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-80f28b87-6751-4776-8002-49a361a0b469 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547812 Aug 24 11:37:04.540140 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 516/1048] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:37:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:37:04.542894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e72abe99-90c9-4f07-8846-02a057345da7 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:04.543513 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e72abe99-90c9-4f07-8846-02a057345da7 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:04.547242 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:04.603345 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e72abe99-90c9-4f07-8846-02a057345da7 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:04.610503 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e72abe99-90c9-4f07-8846-02a057345da7 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1214 microversion: 2.1 time: 0.071540 Aug 24 11:37:04.611210 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 533/1049] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:04 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:05.631790 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-073693ec-0f96-4075-9497-1edfeddb15be tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:05.633047 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-073693ec-0f96-4075-9497-1edfeddb15be tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:05.688370 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-073693ec-0f96-4075-9497-1edfeddb15be tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:05.696407 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-073693ec-0f96-4075-9497-1edfeddb15be tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1214 microversion: 2.1 time: 0.069129 Aug 24 11:37:05.697006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 517/1050] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:05 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:06.717103 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-29cf08a5-c1e6-46fb-91d5-57290450c664 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:06.717750 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-29cf08a5-c1e6-46fb-91d5-57290450c664 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:06.720477 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:06.725512 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29cf08a5-c1e6-46fb-91d5-57290450c664 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:06.726036 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29cf08a5-c1e6-46fb-91d5-57290450c664 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:06.726476 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29cf08a5-c1e6-46fb-91d5-57290450c664 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:06.727175 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29cf08a5-c1e6-46fb-91d5-57290450c664 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:06.727631 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29cf08a5-c1e6-46fb-91d5-57290450c664 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:06.728056 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29cf08a5-c1e6-46fb-91d5-57290450c664 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:06.794068 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-29cf08a5-c1e6-46fb-91d5-57290450c664 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:06.801746 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-29cf08a5-c1e6-46fb-91d5-57290450c664 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1210 microversion: 2.1 time: 0.088410 Aug 24 11:37:06.805497 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 534/1051] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:06 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:07.824993 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b8b8da64-a4e2-4018-a2cf-6384c1094f95 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:07.825659 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b8b8da64-a4e2-4018-a2cf-6384c1094f95 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:07.832598 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b8b8da64-a4e2-4018-a2cf-6384c1094f95 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:07.832971 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b8b8da64-a4e2-4018-a2cf-6384c1094f95 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:07.833419 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b8b8da64-a4e2-4018-a2cf-6384c1094f95 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:07.834122 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b8b8da64-a4e2-4018-a2cf-6384c1094f95 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:07.834571 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b8b8da64-a4e2-4018-a2cf-6384c1094f95 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:07.834984 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b8b8da64-a4e2-4018-a2cf-6384c1094f95 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:07.902740 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b8b8da64-a4e2-4018-a2cf-6384c1094f95 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:07.910516 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b8b8da64-a4e2-4018-a2cf-6384c1094f95 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1284 microversion: 2.1 time: 0.090171 Aug 24 11:37:07.911077 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 518/1052] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:07 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:08.933822 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-96a63b50-5528-44a0-b339-cc8c470d119d tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:08.934470 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-96a63b50-5528-44a0-b339-cc8c470d119d tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:08.942699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96a63b50-5528-44a0-b339-cc8c470d119d tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:08.943195 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96a63b50-5528-44a0-b339-cc8c470d119d tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:08.943636 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96a63b50-5528-44a0-b339-cc8c470d119d tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:08.944382 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96a63b50-5528-44a0-b339-cc8c470d119d tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:08.944842 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96a63b50-5528-44a0-b339-cc8c470d119d tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:08.945274 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96a63b50-5528-44a0-b339-cc8c470d119d tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:09.102353 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-96a63b50-5528-44a0-b339-cc8c470d119d tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:09.113054 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-96a63b50-5528-44a0-b339-cc8c470d119d tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1314 microversion: 2.1 time: 0.184164 Aug 24 11:37:09.113845 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 535/1053] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:08 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:09.937482 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-7981f19f-70f8-4a99-96d3-0aeb7ea95f6d req-abf878e3-cfe2-4c73-b818-00edb02cb98d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c98ee55-3b6d-46b8-ad9b-65b095f3dc57", "tag": "9617e752-4ca1-4218-80d1-9fad5530cabd"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:09.949066 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-7981f19f-70f8-4a99-96d3-0aeb7ea95f6d req-abf878e3-cfe2-4c73-b818-00edb02cb98d service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:09.949629 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-7981f19f-70f8-4a99-96d3-0aeb7ea95f6d req-abf878e3-cfe2-4c73-b818-00edb02cb98d service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:09.950093 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-7981f19f-70f8-4a99-96d3-0aeb7ea95f6d req-abf878e3-cfe2-4c73-b818-00edb02cb98d service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:09.963209 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-7981f19f-70f8-4a99-96d3-0aeb7ea95f6d req-abf878e3-cfe2-4c73-b818-00edb02cb98d service nova] Creating event network-changed:9617e752-4ca1-4218-80d1-9fad5530cabd for instance 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 on hv-cinder-85427 Aug 24 11:37:09.968432 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-7981f19f-70f8-4a99-96d3-0aeb7ea95f6d req-abf878e3-cfe2-4c73-b818-00edb02cb98d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035607 Aug 24 11:37:09.969324 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 519/1054] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:10.138915 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-951b4f0a-7529-48fd-b6c0-c1158155f6d1 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:10.139559 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-951b4f0a-7529-48fd-b6c0-c1158155f6d1 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:10.147505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-951b4f0a-7529-48fd-b6c0-c1158155f6d1 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:10.147986 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-951b4f0a-7529-48fd-b6c0-c1158155f6d1 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:10.148415 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-951b4f0a-7529-48fd-b6c0-c1158155f6d1 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:10.149106 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-951b4f0a-7529-48fd-b6c0-c1158155f6d1 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:10.149566 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-951b4f0a-7529-48fd-b6c0-c1158155f6d1 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:10.150004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-951b4f0a-7529-48fd-b6c0-c1158155f6d1 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:10.294406 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-951b4f0a-7529-48fd-b6c0-c1158155f6d1 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:10.302235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-951b4f0a-7529-48fd-b6c0-c1158155f6d1 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1314 microversion: 2.1 time: 0.169240 Aug 24 11:37:10.302803 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 536/1055] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:10 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:11.324164 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ab396e44-12fd-4995-b91c-eeeef2a8a121 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:11.324960 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ab396e44-12fd-4995-b91c-eeeef2a8a121 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:11.331385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ab396e44-12fd-4995-b91c-eeeef2a8a121 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:11.331870 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ab396e44-12fd-4995-b91c-eeeef2a8a121 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:11.332302 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ab396e44-12fd-4995-b91c-eeeef2a8a121 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:11.332990 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ab396e44-12fd-4995-b91c-eeeef2a8a121 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:11.333438 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ab396e44-12fd-4995-b91c-eeeef2a8a121 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:11.333858 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ab396e44-12fd-4995-b91c-eeeef2a8a121 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:11.471796 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ab396e44-12fd-4995-b91c-eeeef2a8a121 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:11.478926 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ab396e44-12fd-4995-b91c-eeeef2a8a121 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1314 microversion: 2.1 time: 0.159455 Aug 24 11:37:11.479498 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 520/1056] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:11 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:12.499792 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d525abf0-954c-4cb1-8261-e639f990c374 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:12.500336 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d525abf0-954c-4cb1-8261-e639f990c374 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:12.507443 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d525abf0-954c-4cb1-8261-e639f990c374 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:12.507897 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d525abf0-954c-4cb1-8261-e639f990c374 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:12.508341 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d525abf0-954c-4cb1-8261-e639f990c374 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:12.509058 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d525abf0-954c-4cb1-8261-e639f990c374 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:12.510369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d525abf0-954c-4cb1-8261-e639f990c374 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:12.510804 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d525abf0-954c-4cb1-8261-e639f990c374 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:12.644358 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d525abf0-954c-4cb1-8261-e639f990c374 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:12.652100 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d525abf0-954c-4cb1-8261-e639f990c374 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1314 microversion: 2.1 time: 0.156232 Aug 24 11:37:12.652662 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 537/1057] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:12 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:13.672700 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-aaf365e5-445a-4a81-bc68-d0020ca8d3e9 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:13.673318 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-aaf365e5-445a-4a81-bc68-d0020ca8d3e9 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:13.679908 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aaf365e5-445a-4a81-bc68-d0020ca8d3e9 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:13.680385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aaf365e5-445a-4a81-bc68-d0020ca8d3e9 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:13.680916 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aaf365e5-445a-4a81-bc68-d0020ca8d3e9 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:13.681635 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aaf365e5-445a-4a81-bc68-d0020ca8d3e9 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:13.682114 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aaf365e5-445a-4a81-bc68-d0020ca8d3e9 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:13.682538 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aaf365e5-445a-4a81-bc68-d0020ca8d3e9 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:13.814753 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-aaf365e5-445a-4a81-bc68-d0020ca8d3e9 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:13.822453 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-aaf365e5-445a-4a81-bc68-d0020ca8d3e9 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1314 microversion: 2.1 time: 0.153761 Aug 24 11:37:13.823031 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 521/1058] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:13 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:14.844336 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5088bde6-b5a9-4778-a483-90fc38afed78 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:14.844945 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5088bde6-b5a9-4778-a483-90fc38afed78 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:14.847375 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:14.852579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5088bde6-b5a9-4778-a483-90fc38afed78 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:14.853071 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5088bde6-b5a9-4778-a483-90fc38afed78 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:14.853547 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5088bde6-b5a9-4778-a483-90fc38afed78 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:14.854274 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5088bde6-b5a9-4778-a483-90fc38afed78 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:14.854735 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5088bde6-b5a9-4778-a483-90fc38afed78 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:14.855161 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5088bde6-b5a9-4778-a483-90fc38afed78 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:14.986950 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5088bde6-b5a9-4778-a483-90fc38afed78 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:14.994681 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5088bde6-b5a9-4778-a483-90fc38afed78 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1314 microversion: 2.1 time: 0.154883 Aug 24 11:37:14.997668 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 538/1059] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:14 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:16.016979 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7dfc7b02-e7e1-421c-a148-dec0f545839b tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:16.017467 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7dfc7b02-e7e1-421c-a148-dec0f545839b tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:16.019763 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:16.025369 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=8 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:16.031803 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7dfc7b02-e7e1-421c-a148-dec0f545839b tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:16.031803 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7dfc7b02-e7e1-421c-a148-dec0f545839b tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:16.031803 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7dfc7b02-e7e1-421c-a148-dec0f545839b tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:16.031803 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7dfc7b02-e7e1-421c-a148-dec0f545839b tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:16.032174 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7dfc7b02-e7e1-421c-a148-dec0f545839b tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:16.032174 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7dfc7b02-e7e1-421c-a148-dec0f545839b tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:16.034652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=72 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:16.167657 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7dfc7b02-e7e1-421c-a148-dec0f545839b tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:16.176108 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7dfc7b02-e7e1-421c-a148-dec0f545839b tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1314 microversion: 2.1 time: 0.163929 Aug 24 11:37:16.176647 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 522/1060] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:16 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:17.196603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-696f2284-ebf0-4c45-bbf7-aa9debfd6989 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:17.197299 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-696f2284-ebf0-4c45-bbf7-aa9debfd6989 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:17.204518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-696f2284-ebf0-4c45-bbf7-aa9debfd6989 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:17.205007 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-696f2284-ebf0-4c45-bbf7-aa9debfd6989 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:17.205447 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-696f2284-ebf0-4c45-bbf7-aa9debfd6989 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:17.206217 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-696f2284-ebf0-4c45-bbf7-aa9debfd6989 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:17.206677 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-696f2284-ebf0-4c45-bbf7-aa9debfd6989 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:17.207105 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-696f2284-ebf0-4c45-bbf7-aa9debfd6989 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:17.335581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-696f2284-ebf0-4c45-bbf7-aa9debfd6989 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:17.343315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-696f2284-ebf0-4c45-bbf7-aa9debfd6989 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1314 microversion: 2.1 time: 0.150609 Aug 24 11:37:17.343910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 539/1061] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:17 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:17.912986 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-fd20d7b2-d7af-44c6-8584-1fc59900c9d8 req-8eb71f5a-1e86-4eca-8d20-7f9c6c820015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c98ee55-3b6d-46b8-ad9b-65b095f3dc57", "name": "network-vif-plugged", "status": "completed", "tag": "9617e752-4ca1-4218-80d1-9fad5530cabd"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:17.924573 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fd20d7b2-d7af-44c6-8584-1fc59900c9d8 req-8eb71f5a-1e86-4eca-8d20-7f9c6c820015 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:17.925060 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fd20d7b2-d7af-44c6-8584-1fc59900c9d8 req-8eb71f5a-1e86-4eca-8d20-7f9c6c820015 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:17.925495 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fd20d7b2-d7af-44c6-8584-1fc59900c9d8 req-8eb71f5a-1e86-4eca-8d20-7f9c6c820015 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:17.936905 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-fd20d7b2-d7af-44c6-8584-1fc59900c9d8 req-8eb71f5a-1e86-4eca-8d20-7f9c6c820015 service nova] Creating event network-vif-plugged:9617e752-4ca1-4218-80d1-9fad5530cabd for instance 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 on hv-cinder-85427 Aug 24 11:37:17.942104 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-fd20d7b2-d7af-44c6-8584-1fc59900c9d8 req-8eb71f5a-1e86-4eca-8d20-7f9c6c820015 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033461 Aug 24 11:37:17.942700 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 523/1062] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:18.364166 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-19273d8f-a54c-4c46-8c45-f9554175d279 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:18.364843 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-19273d8f-a54c-4c46-8c45-f9554175d279 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:18.371233 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19273d8f-a54c-4c46-8c45-f9554175d279 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:18.371718 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19273d8f-a54c-4c46-8c45-f9554175d279 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:18.372150 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19273d8f-a54c-4c46-8c45-f9554175d279 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:18.372840 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19273d8f-a54c-4c46-8c45-f9554175d279 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:18.373293 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19273d8f-a54c-4c46-8c45-f9554175d279 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:18.373714 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-19273d8f-a54c-4c46-8c45-f9554175d279 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:18.515754 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-19273d8f-a54c-4c46-8c45-f9554175d279 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:18.523824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-19273d8f-a54c-4c46-8c45-f9554175d279 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1314 microversion: 2.1 time: 0.163645 Aug 24 11:37:18.524392 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 540/1063] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:18 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:19.549966 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5023baac-bed7-48d6-aeec-15c0f79eb677 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:19.550696 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5023baac-bed7-48d6-aeec-15c0f79eb677 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:19.552634 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:19.557925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5023baac-bed7-48d6-aeec-15c0f79eb677 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:19.558934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5023baac-bed7-48d6-aeec-15c0f79eb677 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:19.558934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5023baac-bed7-48d6-aeec-15c0f79eb677 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:19.559805 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5023baac-bed7-48d6-aeec-15c0f79eb677 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:19.560265 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5023baac-bed7-48d6-aeec-15c0f79eb677 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:19.560686 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5023baac-bed7-48d6-aeec-15c0f79eb677 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:19.696550 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5023baac-bed7-48d6-aeec-15c0f79eb677 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:19.704464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5023baac-bed7-48d6-aeec-15c0f79eb677 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1314 microversion: 2.1 time: 0.159178 Aug 24 11:37:19.705033 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 524/1064] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:19 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:20.725200 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3d71b2ce-f204-4d39-a60c-8311a4d3cb89 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:20.725859 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3d71b2ce-f204-4d39-a60c-8311a4d3cb89 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:20.732557 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3d71b2ce-f204-4d39-a60c-8311a4d3cb89 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:20.733051 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3d71b2ce-f204-4d39-a60c-8311a4d3cb89 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:20.733492 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3d71b2ce-f204-4d39-a60c-8311a4d3cb89 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:20.734250 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3d71b2ce-f204-4d39-a60c-8311a4d3cb89 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:20.734707 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3d71b2ce-f204-4d39-a60c-8311a4d3cb89 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:20.735132 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3d71b2ce-f204-4d39-a60c-8311a4d3cb89 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:20.863940 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3d71b2ce-f204-4d39-a60c-8311a4d3cb89 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:20.871715 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3d71b2ce-f204-4d39-a60c-8311a4d3cb89 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1464 microversion: 2.1 time: 0.150886 Aug 24 11:37:20.872291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 541/1065] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:20 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:20.916907 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9e97cb4e-ce05-487a-bf7f-e5bbd77ebd23 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:20.917385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9e97cb4e-ce05-487a-bf7f-e5bbd77ebd23 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:20.924192 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e97cb4e-ce05-487a-bf7f-e5bbd77ebd23 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:20.924679 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e97cb4e-ce05-487a-bf7f-e5bbd77ebd23 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:20.925108 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e97cb4e-ce05-487a-bf7f-e5bbd77ebd23 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:20.925795 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e97cb4e-ce05-487a-bf7f-e5bbd77ebd23 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:20.926279 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e97cb4e-ce05-487a-bf7f-e5bbd77ebd23 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:20.926700 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9e97cb4e-ce05-487a-bf7f-e5bbd77ebd23 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:20.952069 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9e97cb4e-ce05-487a-bf7f-e5bbd77ebd23 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Going to try to terminate instance {{(pid=121222) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:37:21.425651 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9e97cb4e-ce05-487a-bf7f-e5bbd77ebd23 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 204 len: 0 microversion: 2.1 time: 0.512221 Aug 24 11:37:21.426286 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 525/1066] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:37:20 2022] DELETE /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:37:21.434704 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8a121018-5af5-46f4-87bb-7f5dc7e56495 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:21.435325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8a121018-5af5-46f4-87bb-7f5dc7e56495 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:21.441238 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a121018-5af5-46f4-87bb-7f5dc7e56495 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:21.441723 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a121018-5af5-46f4-87bb-7f5dc7e56495 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:21.442200 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a121018-5af5-46f4-87bb-7f5dc7e56495 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:21.442894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a121018-5af5-46f4-87bb-7f5dc7e56495 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:21.443358 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a121018-5af5-46f4-87bb-7f5dc7e56495 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:21.443783 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a121018-5af5-46f4-87bb-7f5dc7e56495 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:21.577469 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8a121018-5af5-46f4-87bb-7f5dc7e56495 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:21.585727 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8a121018-5af5-46f4-87bb-7f5dc7e56495 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1470 microversion: 2.1 time: 0.154943 Aug 24 11:37:21.586353 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 542/1067] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:21 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:22.610103 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-19206021-795d-4239-a470-c051e409f7ec tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:22.610910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-19206021-795d-4239-a470-c051e409f7ec tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:22.618108 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-19206021-795d-4239-a470-c051e409f7ec tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:22.618612 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-19206021-795d-4239-a470-c051e409f7ec tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:22.619048 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-19206021-795d-4239-a470-c051e409f7ec tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:22.619737 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-19206021-795d-4239-a470-c051e409f7ec tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:22.620173 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-19206021-795d-4239-a470-c051e409f7ec tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:22.620585 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-19206021-795d-4239-a470-c051e409f7ec tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:22.754757 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-19206021-795d-4239-a470-c051e409f7ec tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:22.762985 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-19206021-795d-4239-a470-c051e409f7ec tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1470 microversion: 2.1 time: 0.158804 Aug 24 11:37:22.763555 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 526/1068] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:22 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:23.785337 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-84e54460-376b-4758-9f06-c0d803cc6d12 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:23.785977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-84e54460-376b-4758-9f06-c0d803cc6d12 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:23.792579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-84e54460-376b-4758-9f06-c0d803cc6d12 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:23.793069 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-84e54460-376b-4758-9f06-c0d803cc6d12 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:23.793564 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-84e54460-376b-4758-9f06-c0d803cc6d12 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:23.794270 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-84e54460-376b-4758-9f06-c0d803cc6d12 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:23.794728 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-84e54460-376b-4758-9f06-c0d803cc6d12 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:23.801537 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-84e54460-376b-4758-9f06-c0d803cc6d12 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:23.929470 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-84e54460-376b-4758-9f06-c0d803cc6d12 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:23.937608 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-84e54460-376b-4758-9f06-c0d803cc6d12 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1470 microversion: 2.1 time: 0.156465 Aug 24 11:37:23.938244 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 543/1069] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:23 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:24.158064 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-4e61f437-8608-4f2b-8ee4-6690ac47ec9b req-91e6b411-94df-4410-a160-c29a1dc1ae9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c98ee55-3b6d-46b8-ad9b-65b095f3dc57", "name": "network-vif-deleted", "tag": "9617e752-4ca1-4218-80d1-9fad5530cabd"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:24.168383 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-4e61f437-8608-4f2b-8ee4-6690ac47ec9b req-91e6b411-94df-4410-a160-c29a1dc1ae9b service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:24.168939 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-4e61f437-8608-4f2b-8ee4-6690ac47ec9b req-91e6b411-94df-4410-a160-c29a1dc1ae9b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:24.169449 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-4e61f437-8608-4f2b-8ee4-6690ac47ec9b req-91e6b411-94df-4410-a160-c29a1dc1ae9b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:24.181864 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-4e61f437-8608-4f2b-8ee4-6690ac47ec9b req-91e6b411-94df-4410-a160-c29a1dc1ae9b service nova] Creating event network-vif-deleted:9617e752-4ca1-4218-80d1-9fad5530cabd for instance 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 on hv-cinder-85427 Aug 24 11:37:24.187192 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-4e61f437-8608-4f2b-8ee4-6690ac47ec9b req-91e6b411-94df-4410-a160-c29a1dc1ae9b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033376 Aug 24 11:37:24.188011 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 527/1070] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:24.969770 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9e51d6ba-1001-495e-a0dc-0b2550ea5fd3 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:24.970436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9e51d6ba-1001-495e-a0dc-0b2550ea5fd3 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:24.976910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e51d6ba-1001-495e-a0dc-0b2550ea5fd3 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:24.981195 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e51d6ba-1001-495e-a0dc-0b2550ea5fd3 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:24.981195 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e51d6ba-1001-495e-a0dc-0b2550ea5fd3 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:24.981195 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e51d6ba-1001-495e-a0dc-0b2550ea5fd3 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:24.981195 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e51d6ba-1001-495e-a0dc-0b2550ea5fd3 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:24.981602 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e51d6ba-1001-495e-a0dc-0b2550ea5fd3 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:25.012183 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e51d6ba-1001-495e-a0dc-0b2550ea5fd3 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:25.012811 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e51d6ba-1001-495e-a0dc-0b2550ea5fd3 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:25.013095 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e51d6ba-1001-495e-a0dc-0b2550ea5fd3 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:25.013537 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-9e51d6ba-1001-495e-a0dc-0b2550ea5fd3 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lazy-loading 'fault' on Instance uuid 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:37:25.054220 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9e51d6ba-1001-495e-a0dc-0b2550ea5fd3 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc45029842477e92552609037f2e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4d27b24d8e5430c93890088fb6386db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:25.062055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9e51d6ba-1001-495e-a0dc-0b2550ea5fd3 tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 200 len: 1304 microversion: 2.1 time: 0.096094 Aug 24 11:37:25.062633 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 544/1071] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:24 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:26.084951 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-db4132d8-6ca9-407e-98c8-84ff15426afd tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:26.085688 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-db4132d8-6ca9-407e-98c8-84ff15426afd tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] [instance: 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:26.091935 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-db4132d8-6ca9-407e-98c8-84ff15426afd tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:26.092424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-db4132d8-6ca9-407e-98c8-84ff15426afd tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:26.092865 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-db4132d8-6ca9-407e-98c8-84ff15426afd tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:26.093563 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-db4132d8-6ca9-407e-98c8-84ff15426afd tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:26.094060 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-db4132d8-6ca9-407e-98c8-84ff15426afd tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:26.094494 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-db4132d8-6ca9-407e-98c8-84ff15426afd tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:26.107813 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-db4132d8-6ca9-407e-98c8-84ff15426afd tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] HTTP exception thrown: Instance 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 could not be found. Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-db4132d8-6ca9-407e-98c8-84ff15426afd tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Request method failure captured: Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 HTTP/1.1 Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBg1cJB11L00QYTJanmYwUSUAVQzhHWY3oFxNFOTMIm9c1FoQNGyk_4xalAQhH8X-apjzjEzJ2wPWLEWLdTosaTe3zxWFhXwoliXLVomzfTONRBYGLDnAJle8wRY2wMCA_2RfBgnZT9dCJps8JVGhXWQtgUXFP8U4htg011QbXNlwyfE Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: b4d27b24d8e5430c93890088fb6386db Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-VolumesNegativeTest-1890229702 Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:37:26.109447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:37:26.111281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b4d27b24d8e5430c93890088fb6386db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b4d27b24d8e5430c93890088fb6386db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b4d27b24d8e5430c93890088fb6386db", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b4d27b24d8e5430c93890088fb6386db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:37:26.111281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-VolumesNegativeTest-1890229702 Aug 24 11:37:26.111281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: b4d27b24d8e5430c93890088fb6386db Aug 24 11:37:26.111281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-VolumesNegativeTest-1890229702 Aug 24 11:37:26.111281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-VolumesNegativeTest-1890229702-project Aug 24 11:37:26.111281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:37:26.111281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:37:26.111281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: effc45029842477e92552609037f2e35 Aug 24 11:37:26.111281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-VolumesNegativeTest-1890229702-project Aug 24 11:37:26.111281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:37:26.111281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 could not be found. Aug 24 11:37:26.111281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': '9c98ee55-3b6d-46b8-ad9b-65b095f3dc57'} Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 could not be found. Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:37:26.112237 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 could not be found. Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 could not be found. Aug 24 11:37:26.113752 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:37:26.115060 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-db4132d8-6ca9-407e-98c8-84ff15426afd tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] Returning 404 to user: Instance 9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:37:26.115060 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-db4132d8-6ca9-407e-98c8-84ff15426afd tempest-VolumesNegativeTest-1890229702 tempest-VolumesNegativeTest-1890229702-project] 10.222.0.83 "GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57" status: 404 len: 111 microversion: 2.1 time: 0.030650 Aug 24 11:37:26.115060 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 528/1072] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:26 2022] GET /compute/v2.1/servers/9c98ee55-3b6d-46b8-ad9b-65b095f3dc57 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:37:39.451700 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-523963396", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "networks": [{"uuid": "9cd1c38c-e4cc-4681-aabe-1583cbcda9f4"}]}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:39.460701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=27 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:39.461367 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=68 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:39.506832 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] validate_networks() for [('9cd1c38c-e4cc-4681-aabe-1583cbcda9f4', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:37:39.867020 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:37:39.867437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:37:39.867909 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:37:39.868317 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:37:39.868726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:37:39.877719 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:39.878235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:39.878665 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:39.885686 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:39.885686 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:39.885686 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:39.899193 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Getting quotas for project 3583d4d34a634ea9a30c1f96ba70a664. Resources: {'cores', 'instances', 'ram'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:37:39.903765 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Getting quotas for user 2e40e7790fe94c388cb206aab7c94734 and project 3583d4d34a634ea9a30c1f96ba70a664. Resources: {'cores', 'instances', 'ram'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:37:39.915916 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:37:39.918232 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:37:40.142106 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a6b6d7c3-ac2d-4eda-a84d-cc5e0f7c56fc tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696445 Aug 24 11:37:40.143053 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 545/1073] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:37:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:37:40.154925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ca8211af-bd6d-4383-a685-22d8fccfb7ba tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:40.155635 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ca8211af-bd6d-4383-a685-22d8fccfb7ba tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:40.158135 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:40.158914 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:40.221955 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ca8211af-bd6d-4383-a685-22d8fccfb7ba tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:40.229360 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ca8211af-bd6d-4383-a685-22d8fccfb7ba tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1218 microversion: 2.1 time: 0.078392 Aug 24 11:37:40.230468 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 529/1074] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:40 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:41.251247 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-772c56ce-78c2-493e-9bbf-ef289d12126e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:41.251854 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-772c56ce-78c2-493e-9bbf-ef289d12126e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:41.305399 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-772c56ce-78c2-493e-9bbf-ef289d12126e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:41.312475 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-772c56ce-78c2-493e-9bbf-ef289d12126e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1218 microversion: 2.1 time: 0.065562 Aug 24 11:37:41.313041 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 546/1075] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:41 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:42.333437 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d77bef33-4533-4ad2-a5e1-c2621868487e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:42.334096 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d77bef33-4533-4ad2-a5e1-c2621868487e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:42.342369 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d77bef33-4533-4ad2-a5e1-c2621868487e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:42.342856 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d77bef33-4533-4ad2-a5e1-c2621868487e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:42.343347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d77bef33-4533-4ad2-a5e1-c2621868487e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:42.344009 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d77bef33-4533-4ad2-a5e1-c2621868487e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:42.344447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d77bef33-4533-4ad2-a5e1-c2621868487e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:42.344871 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d77bef33-4533-4ad2-a5e1-c2621868487e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:42.412288 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d77bef33-4533-4ad2-a5e1-c2621868487e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:42.420548 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d77bef33-4533-4ad2-a5e1-c2621868487e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1214 microversion: 2.1 time: 0.091598 Aug 24 11:37:42.421177 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 530/1076] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:42 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:43.441974 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9e23ba74-023d-4c00-b239-f2d1523d7be4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:43.443557 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9e23ba74-023d-4c00-b239-f2d1523d7be4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:43.455660 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e23ba74-023d-4c00-b239-f2d1523d7be4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:43.456154 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e23ba74-023d-4c00-b239-f2d1523d7be4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:43.456634 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e23ba74-023d-4c00-b239-f2d1523d7be4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:43.457342 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e23ba74-023d-4c00-b239-f2d1523d7be4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:43.457788 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e23ba74-023d-4c00-b239-f2d1523d7be4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:43.458334 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9e23ba74-023d-4c00-b239-f2d1523d7be4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:43.529670 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9e23ba74-023d-4c00-b239-f2d1523d7be4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:43.538734 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9e23ba74-023d-4c00-b239-f2d1523d7be4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1276 microversion: 2.1 time: 0.100737 Aug 24 11:37:43.539579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 547/1077] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:43 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1276 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:44.540855 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0492ca0a-7efa-4a4d-a58e-87f069731ff4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:44.541643 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0492ca0a-7efa-4a4d-a58e-87f069731ff4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:44.549972 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0492ca0a-7efa-4a4d-a58e-87f069731ff4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.550849 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0492ca0a-7efa-4a4d-a58e-87f069731ff4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.551721 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0492ca0a-7efa-4a4d-a58e-87f069731ff4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.552573 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0492ca0a-7efa-4a4d-a58e-87f069731ff4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.553248 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0492ca0a-7efa-4a4d-a58e-87f069731ff4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.553923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0492ca0a-7efa-4a4d-a58e-87f069731ff4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.560654 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-baba6c34-23c8-489d-9d30-6c93df494f26 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:44.561038 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-baba6c34-23c8-489d-9d30-6c93df494f26 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:44.568178 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-baba6c34-23c8-489d-9d30-6c93df494f26 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.568898 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-baba6c34-23c8-489d-9d30-6c93df494f26 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.569808 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-baba6c34-23c8-489d-9d30-6c93df494f26 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.570775 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-baba6c34-23c8-489d-9d30-6c93df494f26 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.571443 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-baba6c34-23c8-489d-9d30-6c93df494f26 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.572117 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-baba6c34-23c8-489d-9d30-6c93df494f26 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.590100 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0492ca0a-7efa-4a4d-a58e-87f069731ff4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/os-volume_attachments/10f88693-dd0d-4e6b-874b-3a03302ba4df" status: 200 len: 194 microversion: 2.20 time: 0.053703 Aug 24 11:37:44.596541 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 531/1078] 10.222.0.83 () {60 vars in 1454 bytes} [Wed Aug 24 11:37:44 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/os-volume_attachments/10f88693-dd0d-4e6b-874b-3a03302ba4df => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:37:44.667991 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5ddf41fb-7d64-4400-af56-fef41f8832b5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:44.668726 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5ddf41fb-7d64-4400-af56-fef41f8832b5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:44.677344 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5ddf41fb-7d64-4400-af56-fef41f8832b5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.677836 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5ddf41fb-7d64-4400-af56-fef41f8832b5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.678517 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5ddf41fb-7d64-4400-af56-fef41f8832b5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.679219 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5ddf41fb-7d64-4400-af56-fef41f8832b5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.679665 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5ddf41fb-7d64-4400-af56-fef41f8832b5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.680325 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5ddf41fb-7d64-4400-af56-fef41f8832b5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.735393 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-baba6c34-23c8-489d-9d30-6c93df494f26 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:44.737426 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-baba6c34-23c8-489d-9d30-6c93df494f26 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1318 microversion: 2.1 time: 0.181419 Aug 24 11:37:44.751008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 548/1079] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:44 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:44.770751 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-5ddf41fb-7d64-4400-af56-fef41f8832b5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lazy-loading 'services' on Instance uuid 17c6a206-49d7-44b6-a24f-f5961f099597 {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:37:44.953336 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-19933c44-1b61-4aa2-8f56-e26ec57c5e62 req-ecb8a39e-c426-4df9-8066-f8af974b5976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a079430a-6f38-44ec-a7ba-46e075d6a28c", "tag": "8cc57bcf-b9d3-4517-9cdf-6caf5dc22829"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:44.962739 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-19933c44-1b61-4aa2-8f56-e26ec57c5e62 req-ecb8a39e-c426-4df9-8066-f8af974b5976 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:44.963213 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-19933c44-1b61-4aa2-8f56-e26ec57c5e62 req-ecb8a39e-c426-4df9-8066-f8af974b5976 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:44.963641 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-19933c44-1b61-4aa2-8f56-e26ec57c5e62 req-ecb8a39e-c426-4df9-8066-f8af974b5976 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:44.974645 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-19933c44-1b61-4aa2-8f56-e26ec57c5e62 req-ecb8a39e-c426-4df9-8066-f8af974b5976 service nova] Creating event network-changed:8cc57bcf-b9d3-4517-9cdf-6caf5dc22829 for instance a079430a-6f38-44ec-a7ba-46e075d6a28c on hv-cinder-85427 Aug 24 11:37:44.979640 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-19933c44-1b61-4aa2-8f56-e26ec57c5e62 req-ecb8a39e-c426-4df9-8066-f8af974b5976 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030310 Aug 24 11:37:44.980241 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 549/1080] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:37:45.047627 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5ddf41fb-7d64-4400-af56-fef41f8832b5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "DELETE /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/os-volume_attachments/10f88693-dd0d-4e6b-874b-3a03302ba4df" status: 202 len: 0 microversion: 2.20 time: 0.383349 Aug 24 11:37:45.048227 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 532/1081] 10.222.0.83 () {60 vars in 1457 bytes} [Wed Aug 24 11:37:44 2022] DELETE /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/os-volume_attachments/10f88693-dd0d-4e6b-874b-3a03302ba4df => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 11:37:45.057323 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-faed9189-beba-47e4-b9ff-0c43d431f0f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:45.059838 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-faed9189-beba-47e4-b9ff-0c43d431f0f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:45.066635 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-faed9189-beba-47e4-b9ff-0c43d431f0f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:45.067221 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-faed9189-beba-47e4-b9ff-0c43d431f0f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:45.067731 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-faed9189-beba-47e4-b9ff-0c43d431f0f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:45.068543 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-faed9189-beba-47e4-b9ff-0c43d431f0f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:45.069053 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-faed9189-beba-47e4-b9ff-0c43d431f0f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:45.069704 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-faed9189-beba-47e4-b9ff-0c43d431f0f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:45.109062 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-faed9189-beba-47e4-b9ff-0c43d431f0f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055995 Aug 24 11:37:45.110344 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 550/1082] 10.222.0.83 () {60 vars in 1343 bytes} [Wed Aug 24 11:37:45 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:37:45.761110 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3a0d17d0-9928-49d1-9473-61dc783e2e1c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:45.762004 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3a0d17d0-9928-49d1-9473-61dc783e2e1c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:45.769358 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3a0d17d0-9928-49d1-9473-61dc783e2e1c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:45.769865 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3a0d17d0-9928-49d1-9473-61dc783e2e1c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:45.770321 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3a0d17d0-9928-49d1-9473-61dc783e2e1c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:45.771191 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3a0d17d0-9928-49d1-9473-61dc783e2e1c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:45.771749 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3a0d17d0-9928-49d1-9473-61dc783e2e1c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:45.772647 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3a0d17d0-9928-49d1-9473-61dc783e2e1c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:46.005419 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3a0d17d0-9928-49d1-9473-61dc783e2e1c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:46.014721 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3a0d17d0-9928-49d1-9473-61dc783e2e1c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1318 microversion: 2.1 time: 0.258537 Aug 24 11:37:46.015518 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 533/1083] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:45 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:46.122640 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ec1c8215-b857-4beb-aaf4-d5d98c1701ff tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:46.124851 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ec1c8215-b857-4beb-aaf4-d5d98c1701ff tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:46.131735 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ec1c8215-b857-4beb-aaf4-d5d98c1701ff tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:46.132281 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ec1c8215-b857-4beb-aaf4-d5d98c1701ff tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:46.132908 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ec1c8215-b857-4beb-aaf4-d5d98c1701ff tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:46.134196 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ec1c8215-b857-4beb-aaf4-d5d98c1701ff tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:46.134660 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ec1c8215-b857-4beb-aaf4-d5d98c1701ff tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:46.135085 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ec1c8215-b857-4beb-aaf4-d5d98c1701ff tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:46.166727 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ec1c8215-b857-4beb-aaf4-d5d98c1701ff tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048714 Aug 24 11:37:46.167314 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 551/1084] 10.222.0.83 () {60 vars in 1343 bytes} [Wed Aug 24 11:37:46 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:37:47.035824 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-811ef550-3a72-4966-9af3-f358c62ed5d1 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:47.041439 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-811ef550-3a72-4966-9af3-f358c62ed5d1 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:47.042995 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-811ef550-3a72-4966-9af3-f358c62ed5d1 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.043477 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-811ef550-3a72-4966-9af3-f358c62ed5d1 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.043905 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-811ef550-3a72-4966-9af3-f358c62ed5d1 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.044730 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-811ef550-3a72-4966-9af3-f358c62ed5d1 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.045023 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-811ef550-3a72-4966-9af3-f358c62ed5d1 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.045473 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-811ef550-3a72-4966-9af3-f358c62ed5d1 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.183367 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-811ef550-3a72-4966-9af3-f358c62ed5d1 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:47.183855 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-be882546-aaf6-4e47-a5e0-6a5f0e10ee84 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:47.186051 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-be882546-aaf6-4e47-a5e0-6a5f0e10ee84 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:47.193394 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-811ef550-3a72-4966-9af3-f358c62ed5d1 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1318 microversion: 2.1 time: 0.161518 Aug 24 11:37:47.193841 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-be882546-aaf6-4e47-a5e0-6a5f0e10ee84 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.194335 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 534/1085] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:47 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:47.194471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-be882546-aaf6-4e47-a5e0-6a5f0e10ee84 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.194795 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-be882546-aaf6-4e47-a5e0-6a5f0e10ee84 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.195495 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-be882546-aaf6-4e47-a5e0-6a5f0e10ee84 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.195947 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-be882546-aaf6-4e47-a5e0-6a5f0e10ee84 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.196369 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-be882546-aaf6-4e47-a5e0-6a5f0e10ee84 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.228907 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-be882546-aaf6-4e47-a5e0-6a5f0e10ee84 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049004 Aug 24 11:37:47.229486 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 552/1086] 10.222.0.83 () {60 vars in 1343 bytes} [Wed Aug 24 11:37:47 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:47.293900 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-735d5aee-4bd5-4265-98c3-a19aabf51b11 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:47.294428 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-735d5aee-4bd5-4265-98c3-a19aabf51b11 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:47.300463 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-735d5aee-4bd5-4265-98c3-a19aabf51b11 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.300938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-735d5aee-4bd5-4265-98c3-a19aabf51b11 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.301366 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-735d5aee-4bd5-4265-98c3-a19aabf51b11 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.302121 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-735d5aee-4bd5-4265-98c3-a19aabf51b11 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.302579 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-735d5aee-4bd5-4265-98c3-a19aabf51b11 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.302994 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-735d5aee-4bd5-4265-98c3-a19aabf51b11 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.334078 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-735d5aee-4bd5-4265-98c3-a19aabf51b11 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Going to try to terminate instance {{(pid=121222) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:37:47.727373 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-735d5aee-4bd5-4265-98c3-a19aabf51b11 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "DELETE /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 204 len: 0 microversion: 2.20 time: 0.437105 Aug 24 11:37:47.727975 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 535/1087] 10.222.0.83 () {60 vars in 1280 bytes} [Wed Aug 24 11:37:47 2022] DELETE /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 11:37:47.736802 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-71a19b45-ee7a-4755-b91c-4b67d54f13f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:47.738304 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-71a19b45-ee7a-4755-b91c-4b67d54f13f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:47.743441 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71a19b45-ee7a-4755-b91c-4b67d54f13f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.743925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71a19b45-ee7a-4755-b91c-4b67d54f13f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.744362 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71a19b45-ee7a-4755-b91c-4b67d54f13f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.745082 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71a19b45-ee7a-4755-b91c-4b67d54f13f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:47.745534 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71a19b45-ee7a-4755-b91c-4b67d54f13f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:47.745979 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71a19b45-ee7a-4755-b91c-4b67d54f13f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:47.881329 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-71a19b45-ee7a-4755-b91c-4b67d54f13f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:47.890542 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-71a19b45-ee7a-4755-b91c-4b67d54f13f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:47.898286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-71a19b45-ee7a-4755-b91c-4b67d54f13f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:47.898286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-71a19b45-ee7a-4755-b91c-4b67d54f13f3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1724 microversion: 2.20 time: 0.161423 Aug 24 11:37:47.898286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 553/1088] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:47 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:48.215899 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-52504c8a-9d09-49a2-9589-53bc4df6e50f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:48.216591 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-52504c8a-9d09-49a2-9589-53bc4df6e50f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:48.224092 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-52504c8a-9d09-49a2-9589-53bc4df6e50f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:48.224572 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-52504c8a-9d09-49a2-9589-53bc4df6e50f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:48.225005 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-52504c8a-9d09-49a2-9589-53bc4df6e50f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:48.225700 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-52504c8a-9d09-49a2-9589-53bc4df6e50f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:48.226188 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-52504c8a-9d09-49a2-9589-53bc4df6e50f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:48.226607 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-52504c8a-9d09-49a2-9589-53bc4df6e50f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:48.362122 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-52504c8a-9d09-49a2-9589-53bc4df6e50f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:48.369861 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-52504c8a-9d09-49a2-9589-53bc4df6e50f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1318 microversion: 2.1 time: 0.158187 Aug 24 11:37:48.370453 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 536/1089] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:48 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:48.917679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5ccd6e71-6a07-4698-9344-da75dba2d61b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:48.918507 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5ccd6e71-6a07-4698-9344-da75dba2d61b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:48.925225 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ccd6e71-6a07-4698-9344-da75dba2d61b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:48.925790 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ccd6e71-6a07-4698-9344-da75dba2d61b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:48.926196 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ccd6e71-6a07-4698-9344-da75dba2d61b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:48.926962 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ccd6e71-6a07-4698-9344-da75dba2d61b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:48.927418 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ccd6e71-6a07-4698-9344-da75dba2d61b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:48.927840 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ccd6e71-6a07-4698-9344-da75dba2d61b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:49.071022 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5ccd6e71-6a07-4698-9344-da75dba2d61b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:49.079918 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5ccd6e71-6a07-4698-9344-da75dba2d61b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:49.082051 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5ccd6e71-6a07-4698-9344-da75dba2d61b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:49.083253 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5ccd6e71-6a07-4698-9344-da75dba2d61b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1724 microversion: 2.20 time: 0.169732 Aug 24 11:37:49.083833 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 554/1090] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:48 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:49.391163 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b60bd469-fd25-417b-a6eb-ae8c727fda72 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:49.391798 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b60bd469-fd25-417b-a6eb-ae8c727fda72 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:49.398483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b60bd469-fd25-417b-a6eb-ae8c727fda72 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:49.398789 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b60bd469-fd25-417b-a6eb-ae8c727fda72 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:49.399259 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b60bd469-fd25-417b-a6eb-ae8c727fda72 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:49.399906 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b60bd469-fd25-417b-a6eb-ae8c727fda72 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:49.400351 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b60bd469-fd25-417b-a6eb-ae8c727fda72 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:49.400802 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b60bd469-fd25-417b-a6eb-ae8c727fda72 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:49.531088 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b60bd469-fd25-417b-a6eb-ae8c727fda72 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:49.546372 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b60bd469-fd25-417b-a6eb-ae8c727fda72 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1318 microversion: 2.1 time: 0.151990 Aug 24 11:37:49.546372 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 537/1091] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:49 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:50.106534 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c80f27d2-a3fe-4130-a179-d7292bcab9f0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:50.107181 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c80f27d2-a3fe-4130-a179-d7292bcab9f0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:50.110355 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:50.114910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c80f27d2-a3fe-4130-a179-d7292bcab9f0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:50.117981 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c80f27d2-a3fe-4130-a179-d7292bcab9f0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:50.117981 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c80f27d2-a3fe-4130-a179-d7292bcab9f0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:50.117981 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c80f27d2-a3fe-4130-a179-d7292bcab9f0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:50.117981 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c80f27d2-a3fe-4130-a179-d7292bcab9f0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:50.118874 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c80f27d2-a3fe-4130-a179-d7292bcab9f0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:50.255673 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c80f27d2-a3fe-4130-a179-d7292bcab9f0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:50.264656 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c80f27d2-a3fe-4130-a179-d7292bcab9f0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:50.266377 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c80f27d2-a3fe-4130-a179-d7292bcab9f0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:50.267558 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c80f27d2-a3fe-4130-a179-d7292bcab9f0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1724 microversion: 2.20 time: 0.164891 Aug 24 11:37:50.268132 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 555/1092] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:50 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:50.561776 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-94b5672c-3aac-4efc-9a09-8a189f771973 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:50.562538 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-94b5672c-3aac-4efc-9a09-8a189f771973 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:50.564596 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:50.570059 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-94b5672c-3aac-4efc-9a09-8a189f771973 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:50.570555 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-94b5672c-3aac-4efc-9a09-8a189f771973 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:50.571020 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-94b5672c-3aac-4efc-9a09-8a189f771973 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:50.571710 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-94b5672c-3aac-4efc-9a09-8a189f771973 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:50.572185 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-94b5672c-3aac-4efc-9a09-8a189f771973 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:50.572594 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-94b5672c-3aac-4efc-9a09-8a189f771973 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:50.716262 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-94b5672c-3aac-4efc-9a09-8a189f771973 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:50.725100 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-94b5672c-3aac-4efc-9a09-8a189f771973 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1318 microversion: 2.1 time: 0.168065 Aug 24 11:37:50.725689 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 538/1093] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:50 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:51.292979 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5ed61658-8027-4e22-b7f5-8d79af302951 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:51.294148 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5ed61658-8027-4e22-b7f5-8d79af302951 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:51.305546 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ed61658-8027-4e22-b7f5-8d79af302951 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:51.306160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ed61658-8027-4e22-b7f5-8d79af302951 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:51.306793 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ed61658-8027-4e22-b7f5-8d79af302951 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:51.308030 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ed61658-8027-4e22-b7f5-8d79af302951 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:51.308494 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ed61658-8027-4e22-b7f5-8d79af302951 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:51.309209 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ed61658-8027-4e22-b7f5-8d79af302951 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:51.310020 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=8 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:37:51.457924 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5ed61658-8027-4e22-b7f5-8d79af302951 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:51.470965 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5ed61658-8027-4e22-b7f5-8d79af302951 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:51.472471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5ed61658-8027-4e22-b7f5-8d79af302951 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:51.473708 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5ed61658-8027-4e22-b7f5-8d79af302951 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1724 microversion: 2.20 time: 0.186537 Aug 24 11:37:51.474753 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 556/1094] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:51 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:51.725623 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-65ec77ff-2aa9-4f51-af62-6b0bc0ab6e19 req-26acc0c6-7f83-4961-83c3-c2e871718b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c6a206-49d7-44b6-a24f-f5961f099597", "name": "network-vif-deleted", "tag": "dfa0d250-97f7-4d9a-9f1c-edee2d559865"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:51.736674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-65ec77ff-2aa9-4f51-af62-6b0bc0ab6e19 req-26acc0c6-7f83-4961-83c3-c2e871718b4b service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:51.736833 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-65ec77ff-2aa9-4f51-af62-6b0bc0ab6e19 req-26acc0c6-7f83-4961-83c3-c2e871718b4b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:51.737896 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-65ec77ff-2aa9-4f51-af62-6b0bc0ab6e19 req-26acc0c6-7f83-4961-83c3-c2e871718b4b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:51.747879 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bbda5a40-b038-4b76-a346-a1b1f4c94661 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:51.748637 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bbda5a40-b038-4b76-a346-a1b1f4c94661 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:51.751439 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-65ec77ff-2aa9-4f51-af62-6b0bc0ab6e19 req-26acc0c6-7f83-4961-83c3-c2e871718b4b service nova] Creating event network-vif-deleted:dfa0d250-97f7-4d9a-9f1c-edee2d559865 for instance 17c6a206-49d7-44b6-a24f-f5961f099597 on hv-cinder-85427 Aug 24 11:37:51.757209 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-65ec77ff-2aa9-4f51-af62-6b0bc0ab6e19 req-26acc0c6-7f83-4961-83c3-c2e871718b4b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039036 Aug 24 11:37:51.758604 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 539/1095] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:51.762957 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bbda5a40-b038-4b76-a346-a1b1f4c94661 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:51.763573 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bbda5a40-b038-4b76-a346-a1b1f4c94661 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:51.764091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bbda5a40-b038-4b76-a346-a1b1f4c94661 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:51.764833 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bbda5a40-b038-4b76-a346-a1b1f4c94661 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:51.765579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bbda5a40-b038-4b76-a346-a1b1f4c94661 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:51.765694 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bbda5a40-b038-4b76-a346-a1b1f4c94661 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:51.974056 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bbda5a40-b038-4b76-a346-a1b1f4c94661 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:51.994964 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bbda5a40-b038-4b76-a346-a1b1f4c94661 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1318 microversion: 2.1 time: 0.251714 Aug 24 11:37:51.995890 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 557/1096] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:51 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:37:52.497292 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:52.498097 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:52.512216 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:52.512718 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:52.514759 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:52.515759 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:52.518098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:52.518506 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:52.568569 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:52.569118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:52.569726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:52.570551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lazy-loading 'fault' on Instance uuid 17c6a206-49d7-44b6-a24f-f5961f099597 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:37:52.613448 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-5538a9aa-03cb-4a98-b168-365882be200e req-26e3189e-0e33-4c72-8cc0-d3fb85060c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a079430a-6f38-44ec-a7ba-46e075d6a28c", "name": "network-vif-plugged", "status": "completed", "tag": "8cc57bcf-b9d3-4517-9cdf-6caf5dc22829"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:52.634396 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-5538a9aa-03cb-4a98-b168-365882be200e req-26e3189e-0e33-4c72-8cc0-d3fb85060c5a service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:52.635502 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-5538a9aa-03cb-4a98-b168-365882be200e req-26e3189e-0e33-4c72-8cc0-d3fb85060c5a service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:52.636150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-5538a9aa-03cb-4a98-b168-365882be200e req-26e3189e-0e33-4c72-8cc0-d3fb85060c5a service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:52.641544 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:52.650607 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-5538a9aa-03cb-4a98-b168-365882be200e req-26e3189e-0e33-4c72-8cc0-d3fb85060c5a service nova] Creating event network-vif-plugged:8cc57bcf-b9d3-4517-9cdf-6caf5dc22829 for instance a079430a-6f38-44ec-a7ba-46e075d6a28c on hv-cinder-85427 Aug 24 11:37:52.651658 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:52.653152 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:52.654388 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f0acf8fa-4f5e-48b9-abd1-b2ae72f5444b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 200 len: 1371 microversion: 2.20 time: 0.161289 Aug 24 11:37:52.656737 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-5538a9aa-03cb-4a98-b168-365882be200e req-26e3189e-0e33-4c72-8cc0-d3fb85060c5a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.363342 Aug 24 11:37:52.661720 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 540/1097] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:37:52.673934 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 558/1098] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:52 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:37:53.017038 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c9cb0c11-1e0e-4d1e-84ed-52c196b2e521 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:53.017689 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c9cb0c11-1e0e-4d1e-84ed-52c196b2e521 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:53.024960 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c9cb0c11-1e0e-4d1e-84ed-52c196b2e521 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:53.025447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c9cb0c11-1e0e-4d1e-84ed-52c196b2e521 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:53.025930 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c9cb0c11-1e0e-4d1e-84ed-52c196b2e521 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:53.026637 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c9cb0c11-1e0e-4d1e-84ed-52c196b2e521 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:53.027113 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c9cb0c11-1e0e-4d1e-84ed-52c196b2e521 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:53.027568 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c9cb0c11-1e0e-4d1e-84ed-52c196b2e521 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:53.229998 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c9cb0c11-1e0e-4d1e-84ed-52c196b2e521 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:53.238305 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c9cb0c11-1e0e-4d1e-84ed-52c196b2e521 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1318 microversion: 2.1 time: 0.225623 Aug 24 11:37:53.238878 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 541/1099] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:53 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:53.677328 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-26a1ef46-ddeb-4912-a68a-b8c44df47bcb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:53.677991 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-26a1ef46-ddeb-4912-a68a-b8c44df47bcb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:53.684387 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26a1ef46-ddeb-4912-a68a-b8c44df47bcb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:53.684868 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26a1ef46-ddeb-4912-a68a-b8c44df47bcb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:53.685302 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26a1ef46-ddeb-4912-a68a-b8c44df47bcb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:53.686038 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26a1ef46-ddeb-4912-a68a-b8c44df47bcb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:53.686481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26a1ef46-ddeb-4912-a68a-b8c44df47bcb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:53.686904 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26a1ef46-ddeb-4912-a68a-b8c44df47bcb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:53.700675 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-26a1ef46-ddeb-4912-a68a-b8c44df47bcb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] HTTP exception thrown: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-26a1ef46-ddeb-4912-a68a-b8c44df47bcb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Request method failure captured: Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 HTTP/1.1 Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgyjhtQXYgncW68BnusXNWePOcVFX2TmeKpKgiit_IKWShPIwHG5aiiUIBmT721QiJ2tB1bn0PiemxeTgvbXO1TlZv10swD4aK_kaMKgGGIQuGaGjuJFjj0Y9OAVgu8dWq_pmonHIMv_zrcJrtcYIKLWAhOxUav9ZRS3pDY-m2A3RO0 Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: de6ccf52d6394c01859a5ccf0774f2d8 Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:37:53.702450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:37:53.707701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_de6ccf52d6394c01859a5ccf0774f2d8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:37:53.707701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:37:53.707701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: de6ccf52d6394c01859a5ccf0774f2d8 Aug 24 11:37:53.707701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:37:53.707701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeShelveTestJSON-323412020-project Aug 24 11:37:53.707701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:37:53.707701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:37:53.707701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 4dfbe3078d714129b5a6e6e45dbc0b25 Aug 24 11:37:53.707701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeShelveTestJSON-323412020-project Aug 24 11:37:53.707701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:37:53.707701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:37:53.707701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '17c6a206-49d7-44b6-a24f-f5961f099597'} Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:37:53.708836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:37:53.710437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:37:53.711826 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-26a1ef46-ddeb-4912-a68a-b8c44df47bcb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Returning 404 to user: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:37:53.711826 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-26a1ef46-ddeb-4912-a68a-b8c44df47bcb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 404 len: 111 microversion: 2.20 time: 0.031233 Aug 24 11:37:53.711826 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 559/1100] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:53 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:37:53.713043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-eb65f66d-e08c-465d-935c-59aa0d9852a2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '.version_select at 0x7f723d12aee0>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:53.848466 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-eb65f66d-e08c-465d-935c-59aa0d9852a2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-740773957" status: 204 len: 0 microversion: 2.20 time: 0.139238 Aug 24 11:37:53.848982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 542/1101] 10.222.0.83 () {60 vars in 1259 bytes} [Wed Aug 24 11:37:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-740773957 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 11:37:54.260071 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-41f1656b-3980-4a22-92fe-7a7db7c1463f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:54.260689 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-41f1656b-3980-4a22-92fe-7a7db7c1463f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:54.267772 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-41f1656b-3980-4a22-92fe-7a7db7c1463f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:54.268268 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-41f1656b-3980-4a22-92fe-7a7db7c1463f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:54.269261 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-41f1656b-3980-4a22-92fe-7a7db7c1463f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:54.270012 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-41f1656b-3980-4a22-92fe-7a7db7c1463f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:54.270470 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-41f1656b-3980-4a22-92fe-7a7db7c1463f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:54.270950 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-41f1656b-3980-4a22-92fe-7a7db7c1463f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:54.476421 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-41f1656b-3980-4a22-92fe-7a7db7c1463f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:54.484370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-41f1656b-3980-4a22-92fe-7a7db7c1463f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1318 microversion: 2.1 time: 0.228517 Aug 24 11:37:54.484998 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 560/1102] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:54 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:54.769924 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-13b550c9-3fdb-44ff-80ff-48283cdb93fd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Action: 'create', calling method: .version_select at 0x7f723d0c8dc0>, body: {"keypair": {"name": "tempest-keypair-2082554467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiU+EmNB+6XjNSt4q7eEMVGf2DX+YIDzn9A9jgGENtiUGV6FPYEtTqnHx+LZYhErNfcO3b6ILMm8X6vtudgBxSofMOfTMeDjpNKQdojUhXAfHXoPIHBWnR9xnHTiXxb4A=="}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:54.786397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-13b550c9-3fdb-44ff-80ff-48283cdb93fd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Getting quotas for project de6ccf52d6394c01859a5ccf0774f2d8. Resources: {'key_pairs'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:37:54.792747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-13b550c9-3fdb-44ff-80ff-48283cdb93fd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Getting quotas for user 4dfbe3078d714129b5a6e6e45dbc0b25 and project de6ccf52d6394c01859a5ccf0774f2d8. Resources: {'key_pairs'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:37:54.912269 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-13b550c9-3fdb-44ff-80ff-48283cdb93fd tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.146751 Aug 24 11:37:54.912798 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 543/1103] 10.222.0.83 () {62 vars in 1200 bytes} [Wed Aug 24 11:37:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 11:37:55.504792 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4e0ac994-f9bc-4948-8f2f-85a72297cb5f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:55.505549 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4e0ac994-f9bc-4948-8f2f-85a72297cb5f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:55.512298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e0ac994-f9bc-4948-8f2f-85a72297cb5f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:55.512772 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e0ac994-f9bc-4948-8f2f-85a72297cb5f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:55.513452 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e0ac994-f9bc-4948-8f2f-85a72297cb5f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:55.514349 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e0ac994-f9bc-4948-8f2f-85a72297cb5f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:55.514970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e0ac994-f9bc-4948-8f2f-85a72297cb5f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:55.515518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e0ac994-f9bc-4948-8f2f-85a72297cb5f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:55.650105 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4e0ac994-f9bc-4948-8f2f-85a72297cb5f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:55.657983 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4e0ac994-f9bc-4948-8f2f-85a72297cb5f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1506 microversion: 2.1 time: 0.157190 Aug 24 11:37:55.658545 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 561/1104] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:37:55 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:37:57.520577 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2099994269", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e286999e-3204-444c-b76a-73c5933f8ba9"}], "security_groups": [{"name": "tempest-securitygroup--238717474"}], "key_name": "tempest-keypair-2082554467", "user_data": "}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:37:57.635708 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] validate_networks() for [('e286999e-3204-444c-b76a-73c5933f8ba9', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:37:58.143937 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:37:58.144352 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:37:58.144852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:37:58.145248 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:37:58.145649 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:37:58.154569 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:58.155038 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:58.155460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:58.156169 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:58.156613 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:58.157024 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:58.175887 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Getting quotas for project de6ccf52d6394c01859a5ccf0774f2d8. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:37:58.180792 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Getting quotas for user 4dfbe3078d714129b5a6e6e45dbc0b25 and project de6ccf52d6394c01859a5ccf0774f2d8. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:37:58.192038 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:37:58.194397 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:37:58.342435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-47cc1d20-0d41-4d4a-aca6-3cfaa5ffee5e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.827178 Aug 24 11:37:58.343094 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 544/1105] 10.222.0.83 () {62 vars in 1188 bytes} [Wed Aug 24 11:37:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 11:37:58.354864 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-90aa6767-8ef4-426f-956b-b0bf747877c2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:58.355690 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-90aa6767-8ef4-426f-956b-b0bf747877c2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:58.422947 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-90aa6767-8ef4-426f-956b-b0bf747877c2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:58.430956 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-90aa6767-8ef4-426f-956b-b0bf747877c2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:58.432507 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-90aa6767-8ef4-426f-956b-b0bf747877c2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:58.433736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-90aa6767-8ef4-426f-956b-b0bf747877c2 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1282 microversion: 2.20 time: 0.082831 Aug 24 11:37:58.434539 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 562/1106] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:58 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1282 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:37:59.455675 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f1f7e1ec-f278-422f-aee1-932f51c65590 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:37:59.456283 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f1f7e1ec-f278-422f-aee1-932f51c65590 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:37:59.464034 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1f7e1ec-f278-422f-aee1-932f51c65590 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:59.464413 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1f7e1ec-f278-422f-aee1-932f51c65590 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:59.464867 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1f7e1ec-f278-422f-aee1-932f51c65590 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:59.465571 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1f7e1ec-f278-422f-aee1-932f51c65590 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:37:59.466123 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1f7e1ec-f278-422f-aee1-932f51c65590 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:37:59.466548 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f1f7e1ec-f278-422f-aee1-932f51c65590 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:37:59.536388 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f1f7e1ec-f278-422f-aee1-932f51c65590 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:59.546756 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f1f7e1ec-f278-422f-aee1-932f51c65590 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:59.548398 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f1f7e1ec-f278-422f-aee1-932f51c65590 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:37:59.549674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f1f7e1ec-f278-422f-aee1-932f51c65590 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1286 microversion: 2.20 time: 0.098390 Aug 24 11:37:59.550270 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 545/1107] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:37:59 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:00.572471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1f18beda-ff66-433f-971d-aa3fbc31318f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:00.573092 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1f18beda-ff66-433f-971d-aa3fbc31318f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:00.580357 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f18beda-ff66-433f-971d-aa3fbc31318f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:00.580850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f18beda-ff66-433f-971d-aa3fbc31318f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:00.581488 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f18beda-ff66-433f-971d-aa3fbc31318f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:00.582212 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f18beda-ff66-433f-971d-aa3fbc31318f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:00.583480 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f18beda-ff66-433f-971d-aa3fbc31318f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:00.583788 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f18beda-ff66-433f-971d-aa3fbc31318f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:00.683699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1f18beda-ff66-433f-971d-aa3fbc31318f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:00.695054 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1f18beda-ff66-433f-971d-aa3fbc31318f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:00.696572 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1f18beda-ff66-433f-971d-aa3fbc31318f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:00.697919 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1f18beda-ff66-433f-971d-aa3fbc31318f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1342 microversion: 2.20 time: 0.129418 Aug 24 11:38:00.698694 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 563/1108] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:00 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1342 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:01.730993 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-117bf08e-ba04-4a22-babe-9fe50490575d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:01.731659 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-117bf08e-ba04-4a22-babe-9fe50490575d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:01.740385 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-117bf08e-ba04-4a22-babe-9fe50490575d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:01.743524 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-117bf08e-ba04-4a22-babe-9fe50490575d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:01.743524 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-117bf08e-ba04-4a22-babe-9fe50490575d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:01.743524 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-117bf08e-ba04-4a22-babe-9fe50490575d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:01.743524 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-117bf08e-ba04-4a22-babe-9fe50490575d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:01.743933 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-117bf08e-ba04-4a22-babe-9fe50490575d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:01.889104 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-117bf08e-ba04-4a22-babe-9fe50490575d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:01.899341 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-117bf08e-ba04-4a22-babe-9fe50490575d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:01.901681 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-117bf08e-ba04-4a22-babe-9fe50490575d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:01.902926 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-117bf08e-ba04-4a22-babe-9fe50490575d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1407 microversion: 2.20 time: 0.177389 Aug 24 11:38:01.905941 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 546/1109] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:01 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:02.761070 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-37c7f9ad-10c6-4f5e-9656-38f65ba0948f req-50435db0-fb84-4014-91c3-2abed3f444f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c3349f-3561-4764-94db-a6a5189f5ff7", "tag": "c52e1955-c066-4d21-adb0-3e0d49febdb3"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:02.771767 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-37c7f9ad-10c6-4f5e-9656-38f65ba0948f req-50435db0-fb84-4014-91c3-2abed3f444f3 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:02.787909 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-37c7f9ad-10c6-4f5e-9656-38f65ba0948f req-50435db0-fb84-4014-91c3-2abed3f444f3 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:02.787909 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-37c7f9ad-10c6-4f5e-9656-38f65ba0948f req-50435db0-fb84-4014-91c3-2abed3f444f3 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:02.787909 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-37c7f9ad-10c6-4f5e-9656-38f65ba0948f req-50435db0-fb84-4014-91c3-2abed3f444f3 service nova] Creating event network-changed:c52e1955-c066-4d21-adb0-3e0d49febdb3 for instance 32c3349f-3561-4764-94db-a6a5189f5ff7 on hv-cinder-85427 Aug 24 11:38:02.789889 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-37c7f9ad-10c6-4f5e-9656-38f65ba0948f req-50435db0-fb84-4014-91c3-2abed3f444f3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101743 Aug 24 11:38:02.790694 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 564/1110] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:38:02.927849 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a1b27efd-515e-492f-b5ab-d2a085313239 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:02.928456 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a1b27efd-515e-492f-b5ab-d2a085313239 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:02.934879 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a1b27efd-515e-492f-b5ab-d2a085313239 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:02.935384 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a1b27efd-515e-492f-b5ab-d2a085313239 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:02.935798 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a1b27efd-515e-492f-b5ab-d2a085313239 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:02.936588 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a1b27efd-515e-492f-b5ab-d2a085313239 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:02.937091 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a1b27efd-515e-492f-b5ab-d2a085313239 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:02.937474 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a1b27efd-515e-492f-b5ab-d2a085313239 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:03.077472 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a1b27efd-515e-492f-b5ab-d2a085313239 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:03.086553 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a1b27efd-515e-492f-b5ab-d2a085313239 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:03.088064 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a1b27efd-515e-492f-b5ab-d2a085313239 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:03.089179 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a1b27efd-515e-492f-b5ab-d2a085313239 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1407 microversion: 2.20 time: 0.166432 Aug 24 11:38:03.089741 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 547/1111] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:02 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:04.112497 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bb644b26-7b56-40ad-8ca6-8daf59667f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:04.113208 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bb644b26-7b56-40ad-8ca6-8daf59667f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:04.120578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bb644b26-7b56-40ad-8ca6-8daf59667f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:04.121067 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bb644b26-7b56-40ad-8ca6-8daf59667f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:04.121523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bb644b26-7b56-40ad-8ca6-8daf59667f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:04.122251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bb644b26-7b56-40ad-8ca6-8daf59667f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:04.122700 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bb644b26-7b56-40ad-8ca6-8daf59667f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:04.123116 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bb644b26-7b56-40ad-8ca6-8daf59667f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:04.265606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bb644b26-7b56-40ad-8ca6-8daf59667f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:04.269197 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:04.275278 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bb644b26-7b56-40ad-8ca6-8daf59667f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:04.278921 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bb644b26-7b56-40ad-8ca6-8daf59667f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:04.278921 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bb644b26-7b56-40ad-8ca6-8daf59667f4a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1407 microversion: 2.20 time: 0.170114 Aug 24 11:38:04.278921 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 565/1112] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:04 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:05.301281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-aa26cd48-a841-4d74-8593-9009f5fa7425 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:05.301908 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-aa26cd48-a841-4d74-8593-9009f5fa7425 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:05.308680 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aa26cd48-a841-4d74-8593-9009f5fa7425 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:05.309166 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aa26cd48-a841-4d74-8593-9009f5fa7425 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:05.309603 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aa26cd48-a841-4d74-8593-9009f5fa7425 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:05.310357 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aa26cd48-a841-4d74-8593-9009f5fa7425 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:05.310874 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aa26cd48-a841-4d74-8593-9009f5fa7425 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:05.311271 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-aa26cd48-a841-4d74-8593-9009f5fa7425 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:05.315458 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:05.462044 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-aa26cd48-a841-4d74-8593-9009f5fa7425 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:05.471508 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-aa26cd48-a841-4d74-8593-9009f5fa7425 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:05.473070 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-aa26cd48-a841-4d74-8593-9009f5fa7425 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:05.476893 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-aa26cd48-a841-4d74-8593-9009f5fa7425 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1407 microversion: 2.20 time: 0.176924 Aug 24 11:38:05.476893 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 548/1113] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:05 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:06.497612 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-226b0e29-f1ac-41b2-a05e-267ba61969ed tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:06.498266 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-226b0e29-f1ac-41b2-a05e-267ba61969ed tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:06.505388 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-226b0e29-f1ac-41b2-a05e-267ba61969ed tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:06.506133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-226b0e29-f1ac-41b2-a05e-267ba61969ed tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:06.506475 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-226b0e29-f1ac-41b2-a05e-267ba61969ed tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:06.507170 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-226b0e29-f1ac-41b2-a05e-267ba61969ed tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:06.507931 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-226b0e29-f1ac-41b2-a05e-267ba61969ed tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:06.508418 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-226b0e29-f1ac-41b2-a05e-267ba61969ed tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:06.663354 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-226b0e29-f1ac-41b2-a05e-267ba61969ed tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:06.677629 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-226b0e29-f1ac-41b2-a05e-267ba61969ed tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:06.679467 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-226b0e29-f1ac-41b2-a05e-267ba61969ed tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:06.680731 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-226b0e29-f1ac-41b2-a05e-267ba61969ed tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1407 microversion: 2.20 time: 0.187952 Aug 24 11:38:06.681400 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 566/1114] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:06 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:07.705109 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1dd9d28f-d3c7-40a3-a776-9f9e9117a042 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:07.706748 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1dd9d28f-d3c7-40a3-a776-9f9e9117a042 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:07.712360 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1dd9d28f-d3c7-40a3-a776-9f9e9117a042 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:07.712893 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1dd9d28f-d3c7-40a3-a776-9f9e9117a042 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:07.713279 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1dd9d28f-d3c7-40a3-a776-9f9e9117a042 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:07.714009 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1dd9d28f-d3c7-40a3-a776-9f9e9117a042 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:07.714467 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1dd9d28f-d3c7-40a3-a776-9f9e9117a042 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:07.714886 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1dd9d28f-d3c7-40a3-a776-9f9e9117a042 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:07.912303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1dd9d28f-d3c7-40a3-a776-9f9e9117a042 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:07.921165 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1dd9d28f-d3c7-40a3-a776-9f9e9117a042 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:07.922725 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1dd9d28f-d3c7-40a3-a776-9f9e9117a042 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:07.923897 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1dd9d28f-d3c7-40a3-a776-9f9e9117a042 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1407 microversion: 2.20 time: 0.223260 Aug 24 11:38:07.924644 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 549/1115] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:07 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:08.946267 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-15d181f1-c283-4968-9af8-50bf4cf1dbaa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:08.947079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-15d181f1-c283-4968-9af8-50bf4cf1dbaa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:08.949567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:08.955244 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15d181f1-c283-4968-9af8-50bf4cf1dbaa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:08.955731 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15d181f1-c283-4968-9af8-50bf4cf1dbaa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:08.956170 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15d181f1-c283-4968-9af8-50bf4cf1dbaa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:08.956879 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15d181f1-c283-4968-9af8-50bf4cf1dbaa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:08.957847 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15d181f1-c283-4968-9af8-50bf4cf1dbaa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:08.958508 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15d181f1-c283-4968-9af8-50bf4cf1dbaa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:09.100905 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-15d181f1-c283-4968-9af8-50bf4cf1dbaa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:09.109767 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-15d181f1-c283-4968-9af8-50bf4cf1dbaa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:09.111283 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-15d181f1-c283-4968-9af8-50bf4cf1dbaa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:09.112386 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-15d181f1-c283-4968-9af8-50bf4cf1dbaa tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1407 microversion: 2.20 time: 0.170428 Aug 24 11:38:09.113094 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 567/1116] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:08 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:10.107035 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-26bb7e70-993e-423c-8338-b6e7175fda03 req-e59b3e53-f042-4817-a0b9-2f31aa3769d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c3349f-3561-4764-94db-a6a5189f5ff7", "name": "network-vif-plugged", "status": "completed", "tag": "c52e1955-c066-4d21-adb0-3e0d49febdb3"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:10.112000 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:10.112670 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=10 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:10.119092 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-26bb7e70-993e-423c-8338-b6e7175fda03 req-e59b3e53-f042-4817-a0b9-2f31aa3769d0 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:10.119572 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-26bb7e70-993e-423c-8338-b6e7175fda03 req-e59b3e53-f042-4817-a0b9-2f31aa3769d0 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:10.120005 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-26bb7e70-993e-423c-8338-b6e7175fda03 req-e59b3e53-f042-4817-a0b9-2f31aa3769d0 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:10.133946 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-26bb7e70-993e-423c-8338-b6e7175fda03 req-e59b3e53-f042-4817-a0b9-2f31aa3769d0 service nova] Creating event network-vif-plugged:c52e1955-c066-4d21-adb0-3e0d49febdb3 for instance 32c3349f-3561-4764-94db-a6a5189f5ff7 on hv-cinder-85427 Aug 24 11:38:10.135577 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0e2934e6-3041-4332-911f-779182aa6ed7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:10.136168 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0e2934e6-3041-4332-911f-779182aa6ed7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:10.138503 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:10.138950 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-26bb7e70-993e-423c-8338-b6e7175fda03 req-e59b3e53-f042-4817-a0b9-2f31aa3769d0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035586 Aug 24 11:38:10.139561 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 550/1117] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:38:10.143926 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e2934e6-3041-4332-911f-779182aa6ed7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:10.144413 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e2934e6-3041-4332-911f-779182aa6ed7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:10.144850 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e2934e6-3041-4332-911f-779182aa6ed7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:10.145551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e2934e6-3041-4332-911f-779182aa6ed7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:10.146041 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e2934e6-3041-4332-911f-779182aa6ed7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:10.146465 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e2934e6-3041-4332-911f-779182aa6ed7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:10.326200 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0e2934e6-3041-4332-911f-779182aa6ed7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:10.335163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0e2934e6-3041-4332-911f-779182aa6ed7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:10.338075 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0e2934e6-3041-4332-911f-779182aa6ed7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:10.339194 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0e2934e6-3041-4332-911f-779182aa6ed7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1407 microversion: 2.20 time: 0.208223 Aug 24 11:38:10.341229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 568/1118] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:10 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:38:11.366491 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1d7b7ae2-4135-46bd-a6a3-c6a73d3ebd8c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:11.367244 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1d7b7ae2-4135-46bd-a6a3-c6a73d3ebd8c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:11.373998 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d7b7ae2-4135-46bd-a6a3-c6a73d3ebd8c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:11.374428 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d7b7ae2-4135-46bd-a6a3-c6a73d3ebd8c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:11.374863 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d7b7ae2-4135-46bd-a6a3-c6a73d3ebd8c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:11.375554 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d7b7ae2-4135-46bd-a6a3-c6a73d3ebd8c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:11.376013 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d7b7ae2-4135-46bd-a6a3-c6a73d3ebd8c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:11.376435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1d7b7ae2-4135-46bd-a6a3-c6a73d3ebd8c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:11.508564 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1d7b7ae2-4135-46bd-a6a3-c6a73d3ebd8c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:11.516797 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1d7b7ae2-4135-46bd-a6a3-c6a73d3ebd8c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:11.518344 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-1d7b7ae2-4135-46bd-a6a3-c6a73d3ebd8c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:11.519524 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1d7b7ae2-4135-46bd-a6a3-c6a73d3ebd8c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1407 microversion: 2.20 time: 0.158811 Aug 24 11:38:11.520085 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 551/1119] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:11 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:12.542065 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-270f2529-054e-4810-950e-f35e8353a43d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:12.542732 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-270f2529-054e-4810-950e-f35e8353a43d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:12.549774 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-270f2529-054e-4810-950e-f35e8353a43d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:12.550286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-270f2529-054e-4810-950e-f35e8353a43d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:12.551297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-270f2529-054e-4810-950e-f35e8353a43d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:12.551919 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-270f2529-054e-4810-950e-f35e8353a43d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:12.552363 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-270f2529-054e-4810-950e-f35e8353a43d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:12.552862 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-270f2529-054e-4810-950e-f35e8353a43d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:12.683704 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-270f2529-054e-4810-950e-f35e8353a43d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:12.692936 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-270f2529-054e-4810-950e-f35e8353a43d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:12.694490 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-270f2529-054e-4810-950e-f35e8353a43d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:12.700068 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-270f2529-054e-4810-950e-f35e8353a43d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1407 microversion: 2.20 time: 0.157694 Aug 24 11:38:12.700068 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 569/1120] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:12 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:13.717921 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9686512c-1a8d-40dd-84be-ea25724703ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:13.718460 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9686512c-1a8d-40dd-84be-ea25724703ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:13.724916 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9686512c-1a8d-40dd-84be-ea25724703ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:13.725403 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9686512c-1a8d-40dd-84be-ea25724703ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:13.725841 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9686512c-1a8d-40dd-84be-ea25724703ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:13.726561 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9686512c-1a8d-40dd-84be-ea25724703ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:13.727015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9686512c-1a8d-40dd-84be-ea25724703ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:13.727437 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9686512c-1a8d-40dd-84be-ea25724703ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:13.858604 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9686512c-1a8d-40dd-84be-ea25724703ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:13.866756 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9686512c-1a8d-40dd-84be-ea25724703ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:13.868326 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9686512c-1a8d-40dd-84be-ea25724703ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:13.869485 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9686512c-1a8d-40dd-84be-ea25724703ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1599 microversion: 2.20 time: 0.155660 Aug 24 11:38:13.870088 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 552/1121] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:38:13 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:38:13.892054 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c5bab5ce-c31a-4fbe-ab6b-dff97c30af87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:13.892624 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c5bab5ce-c31a-4fbe-ab6b-dff97c30af87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:13.899649 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5bab5ce-c31a-4fbe-ab6b-dff97c30af87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:13.900129 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5bab5ce-c31a-4fbe-ab6b-dff97c30af87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:13.900565 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5bab5ce-c31a-4fbe-ab6b-dff97c30af87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:13.901255 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5bab5ce-c31a-4fbe-ab6b-dff97c30af87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:13.901709 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5bab5ce-c31a-4fbe-ab6b-dff97c30af87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:13.902164 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5bab5ce-c31a-4fbe-ab6b-dff97c30af87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:13.980390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c5bab5ce-c31a-4fbe-ab6b-dff97c30af87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092203 Aug 24 11:38:13.981014 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 570/1122] 10.222.0.83 () {60 vars in 1316 bytes} [Wed Aug 24 11:38:13 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:38:15.194984 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-fdc4b533-e412-4faf-954b-f8f51c8567c4 req-406b0175-7d03-4484-bcad-85db60a6f4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c3349f-3561-4764-94db-a6a5189f5ff7", "tag": "c52e1955-c066-4d21-adb0-3e0d49febdb3"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:15.200423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:15.205720 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fdc4b533-e412-4faf-954b-f8f51c8567c4 req-406b0175-7d03-4484-bcad-85db60a6f4e6 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:15.206236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fdc4b533-e412-4faf-954b-f8f51c8567c4 req-406b0175-7d03-4484-bcad-85db60a6f4e6 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:15.206658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fdc4b533-e412-4faf-954b-f8f51c8567c4 req-406b0175-7d03-4484-bcad-85db60a6f4e6 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:15.218457 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-fdc4b533-e412-4faf-954b-f8f51c8567c4 req-406b0175-7d03-4484-bcad-85db60a6f4e6 service nova] Creating event network-changed:c52e1955-c066-4d21-adb0-3e0d49febdb3 for instance 32c3349f-3561-4764-94db-a6a5189f5ff7 on hv-cinder-85427 Aug 24 11:38:15.223541 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-fdc4b533-e412-4faf-954b-f8f51c8567c4 req-406b0175-7d03-4484-bcad-85db60a6f4e6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032315 Aug 24 11:38:15.224215 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 553/1123] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:38:19.810399 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-861f6333-eced-4529-aa5e-97de77c9a4be tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6be8a64d-62dd-4c18-9ec9-17fc7663b983", "device": "/dev/sdb"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:19.813328 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-861f6333-eced-4529-aa5e-97de77c9a4be tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:19.819733 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-861f6333-eced-4529-aa5e-97de77c9a4be tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:19.820222 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-861f6333-eced-4529-aa5e-97de77c9a4be tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:19.820690 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-861f6333-eced-4529-aa5e-97de77c9a4be tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:19.821389 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-861f6333-eced-4529-aa5e-97de77c9a4be tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:19.821844 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-861f6333-eced-4529-aa5e-97de77c9a4be tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:19.822297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-861f6333-eced-4529-aa5e-97de77c9a4be tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:20.753137 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-861f6333-eced-4529-aa5e-97de77c9a4be tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "POST /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.947740 Aug 24 11:38:20.753748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 571/1124] 10.222.0.83 () {60 vars in 1323 bytes} [Wed Aug 24 11:38:19 2022] POST /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c/os-volume_attachments => generated 194 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:38:49.870596 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=26 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:49.875491 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9c1230e1-ddb0-4168-92c0-73329cb3ae3a tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:49.876098 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9c1230e1-ddb0-4168-92c0-73329cb3ae3a tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:49.883999 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9c1230e1-ddb0-4168-92c0-73329cb3ae3a tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:49.887114 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9c1230e1-ddb0-4168-92c0-73329cb3ae3a tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:49.887114 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9c1230e1-ddb0-4168-92c0-73329cb3ae3a tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:49.887114 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9c1230e1-ddb0-4168-92c0-73329cb3ae3a tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:49.887114 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9c1230e1-ddb0-4168-92c0-73329cb3ae3a tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:49.887520 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9c1230e1-ddb0-4168-92c0-73329cb3ae3a tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:49.970901 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-9c1230e1-ddb0-4168-92c0-73329cb3ae3a tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lazy-loading 'services' on Instance uuid a079430a-6f38-44ec-a7ba-46e075d6a28c {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:38:50.181748 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9c1230e1-ddb0-4168-92c0-73329cb3ae3a tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c/os-volume_attachments/6be8a64d-62dd-4c18-9ec9-17fc7663b983" status: 202 len: 0 microversion: 2.1 time: 0.312572 Aug 24 11:38:50.182370 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 554/1125] 10.222.0.83 () {58 vars in 1416 bytes} [Wed Aug 24 11:38:49 2022] DELETE /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c/os-volume_attachments/6be8a64d-62dd-4c18-9ec9-17fc7663b983 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:38:52.365456 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=7 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:52.366328 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:38:52.370409 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1c6c6a59-03f3-434c-b18c-d3d9313650d9 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:52.371032 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1c6c6a59-03f3-434c-b18c-d3d9313650d9 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:52.377527 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c6c6a59-03f3-434c-b18c-d3d9313650d9 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:52.378061 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c6c6a59-03f3-434c-b18c-d3d9313650d9 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:52.378497 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c6c6a59-03f3-434c-b18c-d3d9313650d9 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:52.379195 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c6c6a59-03f3-434c-b18c-d3d9313650d9 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:52.379653 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c6c6a59-03f3-434c-b18c-d3d9313650d9 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:52.380071 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c6c6a59-03f3-434c-b18c-d3d9313650d9 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:52.409097 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1c6c6a59-03f3-434c-b18c-d3d9313650d9 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:38:52.680133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1c6c6a59-03f3-434c-b18c-d3d9313650d9 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 204 len: 0 microversion: 2.1 time: 0.315670 Aug 24 11:38:52.680942 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 572/1126] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:38:52 2022] DELETE /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:38:52.690596 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-64a4725a-69ec-4b60-87cb-8e5396016653 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:52.691323 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-64a4725a-69ec-4b60-87cb-8e5396016653 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:52.697724 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64a4725a-69ec-4b60-87cb-8e5396016653 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:52.698256 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64a4725a-69ec-4b60-87cb-8e5396016653 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:52.698697 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64a4725a-69ec-4b60-87cb-8e5396016653 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:52.699920 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64a4725a-69ec-4b60-87cb-8e5396016653 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:52.700372 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64a4725a-69ec-4b60-87cb-8e5396016653 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:52.700819 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64a4725a-69ec-4b60-87cb-8e5396016653 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:52.842715 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-64a4725a-69ec-4b60-87cb-8e5396016653 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:52.850499 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-64a4725a-69ec-4b60-87cb-8e5396016653 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1512 microversion: 2.1 time: 0.164823 Aug 24 11:38:52.851063 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 555/1127] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:52 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:53.872449 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5bfbf13c-04f4-49e3-a2fb-d07e4ad98866 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:53.873180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5bfbf13c-04f4-49e3-a2fb-d07e4ad98866 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:53.879697 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5bfbf13c-04f4-49e3-a2fb-d07e4ad98866 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:53.880179 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5bfbf13c-04f4-49e3-a2fb-d07e4ad98866 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:53.880618 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5bfbf13c-04f4-49e3-a2fb-d07e4ad98866 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:53.881602 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5bfbf13c-04f4-49e3-a2fb-d07e4ad98866 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:53.882105 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5bfbf13c-04f4-49e3-a2fb-d07e4ad98866 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:53.882533 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5bfbf13c-04f4-49e3-a2fb-d07e4ad98866 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:54.016464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5bfbf13c-04f4-49e3-a2fb-d07e4ad98866 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:54.024187 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5bfbf13c-04f4-49e3-a2fb-d07e4ad98866 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1512 microversion: 2.1 time: 0.156515 Aug 24 11:38:54.024754 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 573/1128] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:53 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:55.044606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ee9259f7-a9ee-4136-92d1-bcef9d8739db tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:55.045222 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ee9259f7-a9ee-4136-92d1-bcef9d8739db tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:55.051745 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ee9259f7-a9ee-4136-92d1-bcef9d8739db tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:55.052222 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ee9259f7-a9ee-4136-92d1-bcef9d8739db tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:55.052652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ee9259f7-a9ee-4136-92d1-bcef9d8739db tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:55.053341 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ee9259f7-a9ee-4136-92d1-bcef9d8739db tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:55.053814 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ee9259f7-a9ee-4136-92d1-bcef9d8739db tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:55.054255 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ee9259f7-a9ee-4136-92d1-bcef9d8739db tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:55.212682 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ee9259f7-a9ee-4136-92d1-bcef9d8739db tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:55.221484 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ee9259f7-a9ee-4136-92d1-bcef9d8739db tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1512 microversion: 2.1 time: 0.180747 Aug 24 11:38:55.222137 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 556/1129] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:55 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:55.579344 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-3f051482-3a2f-4330-9082-eb7fcacee2ca req-2402a8e9-0b80-401e-9ac4-edd436f8d660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a079430a-6f38-44ec-a7ba-46e075d6a28c", "name": "network-vif-deleted", "tag": "8cc57bcf-b9d3-4517-9cdf-6caf5dc22829"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:38:55.589915 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3f051482-3a2f-4330-9082-eb7fcacee2ca req-2402a8e9-0b80-401e-9ac4-edd436f8d660 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:55.590449 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3f051482-3a2f-4330-9082-eb7fcacee2ca req-2402a8e9-0b80-401e-9ac4-edd436f8d660 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:55.590890 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3f051482-3a2f-4330-9082-eb7fcacee2ca req-2402a8e9-0b80-401e-9ac4-edd436f8d660 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:55.602048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-3f051482-3a2f-4330-9082-eb7fcacee2ca req-2402a8e9-0b80-401e-9ac4-edd436f8d660 service nova] Creating event network-vif-deleted:8cc57bcf-b9d3-4517-9cdf-6caf5dc22829 for instance a079430a-6f38-44ec-a7ba-46e075d6a28c on hv-cinder-85427 Aug 24 11:38:55.607647 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-3f051482-3a2f-4330-9082-eb7fcacee2ca req-2402a8e9-0b80-401e-9ac4-edd436f8d660 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032270 Aug 24 11:38:55.611826 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 574/1130] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:38:56.242429 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2631ab93-8c7f-44af-adb2-7c9481c6fab6 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:56.243119 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-2631ab93-8c7f-44af-adb2-7c9481c6fab6 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:56.250447 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2631ab93-8c7f-44af-adb2-7c9481c6fab6 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:56.250937 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2631ab93-8c7f-44af-adb2-7c9481c6fab6 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:56.251365 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2631ab93-8c7f-44af-adb2-7c9481c6fab6 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:56.252085 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2631ab93-8c7f-44af-adb2-7c9481c6fab6 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:56.252531 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2631ab93-8c7f-44af-adb2-7c9481c6fab6 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:56.252951 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2631ab93-8c7f-44af-adb2-7c9481c6fab6 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:56.285212 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2631ab93-8c7f-44af-adb2-7c9481c6fab6 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:56.285676 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2631ab93-8c7f-44af-adb2-7c9481c6fab6 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:56.286143 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2631ab93-8c7f-44af-adb2-7c9481c6fab6 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:56.286577 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-2631ab93-8c7f-44af-adb2-7c9481c6fab6 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lazy-loading 'fault' on Instance uuid a079430a-6f38-44ec-a7ba-46e075d6a28c {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:38:56.334542 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-2631ab93-8c7f-44af-adb2-7c9481c6fab6 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:38:56.342631 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-2631ab93-8c7f-44af-adb2-7c9481c6fab6 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 200 len: 1308 microversion: 2.1 time: 0.103873 Aug 24 11:38:56.343193 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 557/1131] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:56 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:38:57.365302 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-255cd496-4da7-46b6-a58c-41b07864a900 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:38:57.366047 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-255cd496-4da7-46b6-a58c-41b07864a900 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: a079430a-6f38-44ec-a7ba-46e075d6a28c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:38:57.372784 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-255cd496-4da7-46b6-a58c-41b07864a900 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:57.373270 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-255cd496-4da7-46b6-a58c-41b07864a900 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:57.373712 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-255cd496-4da7-46b6-a58c-41b07864a900 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:57.374448 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-255cd496-4da7-46b6-a58c-41b07864a900 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:38:57.374905 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-255cd496-4da7-46b6-a58c-41b07864a900 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:38:57.375330 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-255cd496-4da7-46b6-a58c-41b07864a900 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:38:57.389362 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-255cd496-4da7-46b6-a58c-41b07864a900 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] HTTP exception thrown: Instance a079430a-6f38-44ec-a7ba-46e075d6a28c could not be found. Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-255cd496-4da7-46b6-a58c-41b07864a900 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Request method failure captured: Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c HTTP/1.1 Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBg2A3Y4rw27o9YizrmHDx4r0Tu905CjWGSjKes7e-bx9c-fL2E_0xMhz0RzPbWMVFkqX7LbUglVinSwgqXD6ONNfpfy5NEw-lENpSXEgQvF3NWNM-2bG_MKq1D5KYx0Rl9ArNuRwqdI05J2Sz3hwazv9SryQ8t6jDsS28bToCD5Lhr0 Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 3583d4d34a634ea9a30c1f96ba70a664 Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesSnapshotTestJSON-57851825 Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:38:57.391028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:38:57.392699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3583d4d34a634ea9a30c1f96ba70a664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3583d4d34a634ea9a30c1f96ba70a664"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3583d4d34a634ea9a30c1f96ba70a664", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3583d4d34a634ea9a30c1f96ba70a664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:38:57.392699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesSnapshotTestJSON-57851825 Aug 24 11:38:57.392699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 3583d4d34a634ea9a30c1f96ba70a664 Aug 24 11:38:57.392699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-57851825 Aug 24 11:38:57.392699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesSnapshotTestJSON-57851825-project Aug 24 11:38:57.392699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:38:57.392699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:38:57.392699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 2e40e7790fe94c388cb206aab7c94734 Aug 24 11:38:57.392699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesSnapshotTestJSON-57851825-project Aug 24 11:38:57.392699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:38:57.392699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance a079430a-6f38-44ec-a7ba-46e075d6a28c could not be found. Aug 24 11:38:57.392699 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': 'a079430a-6f38-44ec-a7ba-46e075d6a28c'} Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a079430a-6f38-44ec-a7ba-46e075d6a28c could not be found. Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:38:57.393679 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a079430a-6f38-44ec-a7ba-46e075d6a28c could not be found. Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a079430a-6f38-44ec-a7ba-46e075d6a28c could not be found. Aug 24 11:38:57.395308 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:38:57.396695 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-255cd496-4da7-46b6-a58c-41b07864a900 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Returning 404 to user: Instance a079430a-6f38-44ec-a7ba-46e075d6a28c could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:38:57.396695 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-255cd496-4da7-46b6-a58c-41b07864a900 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c" status: 404 len: 111 microversion: 2.1 time: 0.031856 Aug 24 11:38:57.396695 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 575/1132] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:38:57 2022] GET /compute/v2.1/servers/a079430a-6f38-44ec-a7ba-46e075d6a28c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:39:10.032318 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1096161062", "imageRef": "53069cc0-7367-40b3-9fbc-e40944ba0087", "flavorRef": "452", "networks": [{"uuid": "9cd1c38c-e4cc-4681-aabe-1583cbcda9f4"}]}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:10.040748 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=11 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:10.041505 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:10.088445 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] validate_networks() for [('9cd1c38c-e4cc-4681-aabe-1583cbcda9f4', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:39:10.440273 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:39:10.440698 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:39:10.441176 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:39:10.441586 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:39:10.442033 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:39:10.457852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:10.457852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:10.457852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:10.457852 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:10.458425 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:10.458425 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:10.472003 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Getting quotas for project 3583d4d34a634ea9a30c1f96ba70a664. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:39:10.476058 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Getting quotas for user 2e40e7790fe94c388cb206aab7c94734 and project 3583d4d34a634ea9a30c1f96ba70a664. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:39:10.487259 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:39:10.489549 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='53069cc0-7367-40b3-9fbc-e40944ba0087',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:39:10.688402 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-befcde9e-0446-4289-a972-2d8e1afa3e18 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660300 Aug 24 11:39:10.689281 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 558/1133] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:39:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:39:10.700752 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7ea24184-3fea-4d76-930a-ff98faffd3c7 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:10.701355 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7ea24184-3fea-4d76-930a-ff98faffd3c7 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:10.704985 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:10.705666 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:10.763354 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7ea24184-3fea-4d76-930a-ff98faffd3c7 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:10.771065 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7ea24184-3fea-4d76-930a-ff98faffd3c7 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1219 microversion: 2.1 time: 0.074891 Aug 24 11:39:10.771868 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 576/1134] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:10 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:11.792280 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-402056b6-dc8b-405c-94e7-14e580687549 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:11.792892 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-402056b6-dc8b-405c-94e7-14e580687549 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:11.799582 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-402056b6-dc8b-405c-94e7-14e580687549 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:11.800077 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-402056b6-dc8b-405c-94e7-14e580687549 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:11.800524 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-402056b6-dc8b-405c-94e7-14e580687549 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:11.801215 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-402056b6-dc8b-405c-94e7-14e580687549 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:11.801672 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-402056b6-dc8b-405c-94e7-14e580687549 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:11.802152 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-402056b6-dc8b-405c-94e7-14e580687549 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:11.864317 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-402056b6-dc8b-405c-94e7-14e580687549 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:11.872100 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-402056b6-dc8b-405c-94e7-14e580687549 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1223 microversion: 2.1 time: 0.084251 Aug 24 11:39:11.872664 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 559/1135] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:11 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:12.893617 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c2b8715f-6c89-4a48-a581-1e9e5d6dd1c4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:12.894361 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c2b8715f-6c89-4a48-a581-1e9e5d6dd1c4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:12.905763 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b8715f-6c89-4a48-a581-1e9e5d6dd1c4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:12.906407 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b8715f-6c89-4a48-a581-1e9e5d6dd1c4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:12.906911 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b8715f-6c89-4a48-a581-1e9e5d6dd1c4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:12.908538 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b8715f-6c89-4a48-a581-1e9e5d6dd1c4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:12.909215 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b8715f-6c89-4a48-a581-1e9e5d6dd1c4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:12.909863 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b8715f-6c89-4a48-a581-1e9e5d6dd1c4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:12.971990 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c2b8715f-6c89-4a48-a581-1e9e5d6dd1c4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:12.979650 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c2b8715f-6c89-4a48-a581-1e9e5d6dd1c4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1279 microversion: 2.1 time: 0.090939 Aug 24 11:39:12.980203 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 577/1136] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:12 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:39:14.000508 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7520b22f-c88b-4220-aaed-74a6f68cdb13 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:14.001118 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7520b22f-c88b-4220-aaed-74a6f68cdb13 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:14.007879 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7520b22f-c88b-4220-aaed-74a6f68cdb13 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:14.008378 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7520b22f-c88b-4220-aaed-74a6f68cdb13 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:14.008805 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7520b22f-c88b-4220-aaed-74a6f68cdb13 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:14.009505 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7520b22f-c88b-4220-aaed-74a6f68cdb13 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:14.009989 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7520b22f-c88b-4220-aaed-74a6f68cdb13 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:14.010413 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7520b22f-c88b-4220-aaed-74a6f68cdb13 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:14.143184 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7520b22f-c88b-4220-aaed-74a6f68cdb13 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:14.150950 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7520b22f-c88b-4220-aaed-74a6f68cdb13 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1319 microversion: 2.1 time: 0.154373 Aug 24 11:39:14.151546 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 560/1137] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:13 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:14.477788 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-5cd48784-20b9-4bdc-8167-8a1621aac844 req-ffc708e1-6933-4282-a125-b8984cbab376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "453869d9-bb48-445a-9a0a-eda74447652b", "tag": "ca6f0432-5fd8-461f-83d1-c829288dc4c1"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:14.489286 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5cd48784-20b9-4bdc-8167-8a1621aac844 req-ffc708e1-6933-4282-a125-b8984cbab376 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:14.493837 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5cd48784-20b9-4bdc-8167-8a1621aac844 req-ffc708e1-6933-4282-a125-b8984cbab376 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:14.493837 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5cd48784-20b9-4bdc-8167-8a1621aac844 req-ffc708e1-6933-4282-a125-b8984cbab376 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:14.503345 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-5cd48784-20b9-4bdc-8167-8a1621aac844 req-ffc708e1-6933-4282-a125-b8984cbab376 service nova] Creating event network-changed:ca6f0432-5fd8-461f-83d1-c829288dc4c1 for instance 453869d9-bb48-445a-9a0a-eda74447652b on hv-cinder-85427 Aug 24 11:39:14.509680 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-5cd48784-20b9-4bdc-8167-8a1621aac844 req-ffc708e1-6933-4282-a125-b8984cbab376 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035743 Aug 24 11:39:14.510385 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 578/1138] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:39:15.176229 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a3478b80-126a-4786-a9ed-84f6e2232317 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:15.177051 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a3478b80-126a-4786-a9ed-84f6e2232317 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:15.183425 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a3478b80-126a-4786-a9ed-84f6e2232317 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:15.183905 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a3478b80-126a-4786-a9ed-84f6e2232317 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:15.184339 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a3478b80-126a-4786-a9ed-84f6e2232317 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:15.185091 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a3478b80-126a-4786-a9ed-84f6e2232317 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:15.185542 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a3478b80-126a-4786-a9ed-84f6e2232317 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:15.185985 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a3478b80-126a-4786-a9ed-84f6e2232317 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:15.321301 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a3478b80-126a-4786-a9ed-84f6e2232317 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:15.331523 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a3478b80-126a-4786-a9ed-84f6e2232317 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1319 microversion: 2.1 time: 0.158027 Aug 24 11:39:15.331523 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 561/1139] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:15 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:16.351695 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d2f1602a-fe2f-4255-b30f-0e4334aaff61 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:16.352457 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d2f1602a-fe2f-4255-b30f-0e4334aaff61 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:16.359144 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2f1602a-fe2f-4255-b30f-0e4334aaff61 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:16.359635 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2f1602a-fe2f-4255-b30f-0e4334aaff61 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:16.360077 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2f1602a-fe2f-4255-b30f-0e4334aaff61 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:16.360773 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2f1602a-fe2f-4255-b30f-0e4334aaff61 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:16.361231 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2f1602a-fe2f-4255-b30f-0e4334aaff61 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:16.361659 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2f1602a-fe2f-4255-b30f-0e4334aaff61 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:16.494230 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d2f1602a-fe2f-4255-b30f-0e4334aaff61 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:16.501984 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d2f1602a-fe2f-4255-b30f-0e4334aaff61 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1319 microversion: 2.1 time: 0.155076 Aug 24 11:39:16.502705 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 579/1140] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:16 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:17.523220 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7e73e5fa-32ef-4767-8ed3-04b4d03b8700 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:17.524463 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7e73e5fa-32ef-4767-8ed3-04b4d03b8700 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:17.530514 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7e73e5fa-32ef-4767-8ed3-04b4d03b8700 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:17.531006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7e73e5fa-32ef-4767-8ed3-04b4d03b8700 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:17.531442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7e73e5fa-32ef-4767-8ed3-04b4d03b8700 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:17.532134 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7e73e5fa-32ef-4767-8ed3-04b4d03b8700 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:17.532669 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7e73e5fa-32ef-4767-8ed3-04b4d03b8700 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:17.533092 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7e73e5fa-32ef-4767-8ed3-04b4d03b8700 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:17.674243 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7e73e5fa-32ef-4767-8ed3-04b4d03b8700 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:17.681863 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7e73e5fa-32ef-4767-8ed3-04b4d03b8700 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1319 microversion: 2.1 time: 0.163117 Aug 24 11:39:17.682453 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 562/1141] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:17 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:18.703223 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fa750e03-3ee5-4ba2-a96d-3987353b139c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:18.703758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fa750e03-3ee5-4ba2-a96d-3987353b139c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:18.710274 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa750e03-3ee5-4ba2-a96d-3987353b139c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:18.710795 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa750e03-3ee5-4ba2-a96d-3987353b139c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:18.711236 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa750e03-3ee5-4ba2-a96d-3987353b139c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:18.711935 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa750e03-3ee5-4ba2-a96d-3987353b139c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:18.712394 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa750e03-3ee5-4ba2-a96d-3987353b139c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:18.712822 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fa750e03-3ee5-4ba2-a96d-3987353b139c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:18.844130 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fa750e03-3ee5-4ba2-a96d-3987353b139c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:18.852231 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fa750e03-3ee5-4ba2-a96d-3987353b139c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1319 microversion: 2.1 time: 0.153061 Aug 24 11:39:18.852789 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 580/1142] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:18 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:19.873429 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5adca3a6-14c4-4ef7-b152-59efc0bf238c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:19.874105 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5adca3a6-14c4-4ef7-b152-59efc0bf238c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:19.881071 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5adca3a6-14c4-4ef7-b152-59efc0bf238c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:19.881561 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5adca3a6-14c4-4ef7-b152-59efc0bf238c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:19.882042 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5adca3a6-14c4-4ef7-b152-59efc0bf238c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:19.882773 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5adca3a6-14c4-4ef7-b152-59efc0bf238c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:19.883230 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5adca3a6-14c4-4ef7-b152-59efc0bf238c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:19.883655 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5adca3a6-14c4-4ef7-b152-59efc0bf238c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:20.017671 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5adca3a6-14c4-4ef7-b152-59efc0bf238c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:20.025963 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5adca3a6-14c4-4ef7-b152-59efc0bf238c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1319 microversion: 2.1 time: 0.156346 Aug 24 11:39:20.026539 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 563/1143] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:19 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:21.047816 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f4929a93-e1d9-4d69-9d8f-6a21bca1edea tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:21.048523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f4929a93-e1d9-4d69-9d8f-6a21bca1edea tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:21.051190 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:21.056093 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4929a93-e1d9-4d69-9d8f-6a21bca1edea tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:21.056573 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4929a93-e1d9-4d69-9d8f-6a21bca1edea tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:21.057005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4929a93-e1d9-4d69-9d8f-6a21bca1edea tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:21.057695 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4929a93-e1d9-4d69-9d8f-6a21bca1edea tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:21.058223 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4929a93-e1d9-4d69-9d8f-6a21bca1edea tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:21.058652 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4929a93-e1d9-4d69-9d8f-6a21bca1edea tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:21.190642 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f4929a93-e1d9-4d69-9d8f-6a21bca1edea tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:21.199014 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f4929a93-e1d9-4d69-9d8f-6a21bca1edea tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1319 microversion: 2.1 time: 0.155296 Aug 24 11:39:21.199582 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 581/1144] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:21 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:22.220363 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e3cdebd9-0ade-472d-ab14-6076f9cff896 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:22.220908 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e3cdebd9-0ade-472d-ab14-6076f9cff896 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:22.223348 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:22.224019 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=6 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:22.229283 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e3cdebd9-0ade-472d-ab14-6076f9cff896 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:22.229767 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e3cdebd9-0ade-472d-ab14-6076f9cff896 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:22.230232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e3cdebd9-0ade-472d-ab14-6076f9cff896 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:22.230929 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e3cdebd9-0ade-472d-ab14-6076f9cff896 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:22.231381 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e3cdebd9-0ade-472d-ab14-6076f9cff896 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:22.231839 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e3cdebd9-0ade-472d-ab14-6076f9cff896 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:22.361694 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e3cdebd9-0ade-472d-ab14-6076f9cff896 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:22.369620 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e3cdebd9-0ade-472d-ab14-6076f9cff896 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1319 microversion: 2.1 time: 0.153227 Aug 24 11:39:22.370234 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 564/1145] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:22 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:22.574716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-8876660d-15bf-4b06-91b7-9b2958443011 req-0c2fe6ff-8a23-42e3-8c29-28e3b2511b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453869d9-bb48-445a-9a0a-eda74447652b", "name": "network-vif-plugged", "status": "completed", "tag": "ca6f0432-5fd8-461f-83d1-c829288dc4c1"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:22.574716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8876660d-15bf-4b06-91b7-9b2958443011 req-0c2fe6ff-8a23-42e3-8c29-28e3b2511b80 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:22.574716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8876660d-15bf-4b06-91b7-9b2958443011 req-0c2fe6ff-8a23-42e3-8c29-28e3b2511b80 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:22.574716 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8876660d-15bf-4b06-91b7-9b2958443011 req-0c2fe6ff-8a23-42e3-8c29-28e3b2511b80 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:22.576809 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-8876660d-15bf-4b06-91b7-9b2958443011 req-0c2fe6ff-8a23-42e3-8c29-28e3b2511b80 service nova] Creating event network-vif-plugged:ca6f0432-5fd8-461f-83d1-c829288dc4c1 for instance 453869d9-bb48-445a-9a0a-eda74447652b on hv-cinder-85427 Aug 24 11:39:22.581904 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-8876660d-15bf-4b06-91b7-9b2958443011 req-0c2fe6ff-8a23-42e3-8c29-28e3b2511b80 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031528 Aug 24 11:39:22.582628 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 582/1146] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:39:23.391055 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-58751e15-7b07-4240-a238-d33d3f807c56 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:23.391670 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-58751e15-7b07-4240-a238-d33d3f807c56 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:23.398766 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58751e15-7b07-4240-a238-d33d3f807c56 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:23.399254 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58751e15-7b07-4240-a238-d33d3f807c56 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:23.399854 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58751e15-7b07-4240-a238-d33d3f807c56 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:23.400389 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58751e15-7b07-4240-a238-d33d3f807c56 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:23.400847 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58751e15-7b07-4240-a238-d33d3f807c56 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:23.401277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-58751e15-7b07-4240-a238-d33d3f807c56 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:23.532888 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-58751e15-7b07-4240-a238-d33d3f807c56 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:23.540949 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-58751e15-7b07-4240-a238-d33d3f807c56 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1319 microversion: 2.1 time: 0.153838 Aug 24 11:39:23.541533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 565/1147] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:23 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:24.562809 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-313c654a-f006-4826-877d-e09bfaedd18f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:24.563536 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-313c654a-f006-4826-877d-e09bfaedd18f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:24.571086 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-313c654a-f006-4826-877d-e09bfaedd18f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:24.571567 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-313c654a-f006-4826-877d-e09bfaedd18f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:24.571995 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-313c654a-f006-4826-877d-e09bfaedd18f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:24.572706 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-313c654a-f006-4826-877d-e09bfaedd18f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:24.573151 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-313c654a-f006-4826-877d-e09bfaedd18f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:24.573623 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-313c654a-f006-4826-877d-e09bfaedd18f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:24.707401 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-313c654a-f006-4826-877d-e09bfaedd18f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:24.710801 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-313c654a-f006-4826-877d-e09bfaedd18f tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1319 microversion: 2.1 time: 0.152164 Aug 24 11:39:24.711376 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 583/1148] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:24 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:25.731592 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-24aa7795-1701-4ad9-91d6-b84cc1bd8ca4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:25.732132 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-24aa7795-1701-4ad9-91d6-b84cc1bd8ca4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:25.738631 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-24aa7795-1701-4ad9-91d6-b84cc1bd8ca4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:25.739116 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-24aa7795-1701-4ad9-91d6-b84cc1bd8ca4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:25.739551 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-24aa7795-1701-4ad9-91d6-b84cc1bd8ca4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:25.740241 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-24aa7795-1701-4ad9-91d6-b84cc1bd8ca4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:25.740695 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-24aa7795-1701-4ad9-91d6-b84cc1bd8ca4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:25.741118 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-24aa7795-1701-4ad9-91d6-b84cc1bd8ca4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:25.868012 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-24aa7795-1701-4ad9-91d6-b84cc1bd8ca4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:25.875653 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-24aa7795-1701-4ad9-91d6-b84cc1bd8ca4 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1507 microversion: 2.1 time: 0.148109 Aug 24 11:39:25.876315 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 566/1149] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:25 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:25.897399 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-066a4a52-3cd7-40e3-99e6-6b64949cb995 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3af5a24-b7e7-48d3-be62-f757ee702955", "device": "/dev/sdb"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:25.899809 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-066a4a52-3cd7-40e3-99e6-6b64949cb995 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:25.906337 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-066a4a52-3cd7-40e3-99e6-6b64949cb995 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:25.906896 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-066a4a52-3cd7-40e3-99e6-6b64949cb995 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:25.907253 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-066a4a52-3cd7-40e3-99e6-6b64949cb995 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:25.907937 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-066a4a52-3cd7-40e3-99e6-6b64949cb995 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:25.908384 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-066a4a52-3cd7-40e3-99e6-6b64949cb995 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:25.908806 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-066a4a52-3cd7-40e3-99e6-6b64949cb995 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:26.723670 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-066a4a52-3cd7-40e3-99e6-6b64949cb995 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "POST /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.830211 Aug 24 11:39:26.724299 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 584/1150] 10.222.0.83 () {60 vars in 1323 bytes} [Wed Aug 24 11:39:25 2022] POST /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b/os-volume_attachments => generated 194 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:39:51.506608 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:39:51.507322 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:39:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:39:51.997376 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-bd47d58d-cd8b-456d-a5f3-8ece627323c2 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:51.998073 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-bd47d58d-cd8b-456d-a5f3-8ece627323c2 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:52.000002 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:52.000693 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=50 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:52.005892 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bd47d58d-cd8b-456d-a5f3-8ece627323c2 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:52.006391 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bd47d58d-cd8b-456d-a5f3-8ece627323c2 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:52.006918 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bd47d58d-cd8b-456d-a5f3-8ece627323c2 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:52.007620 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bd47d58d-cd8b-456d-a5f3-8ece627323c2 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:52.008081 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bd47d58d-cd8b-456d-a5f3-8ece627323c2 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:52.008509 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bd47d58d-cd8b-456d-a5f3-8ece627323c2 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:52.246950 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-bd47d58d-cd8b-456d-a5f3-8ece627323c2 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lazy-loading 'services' on Instance uuid 453869d9-bb48-445a-9a0a-eda74447652b {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:39:52.460839 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-bd47d58d-cd8b-456d-a5f3-8ece627323c2 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "DELETE /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b/os-volume_attachments/c3af5a24-b7e7-48d3-be62-f757ee702955" status: 202 len: 0 microversion: 2.1 time: 0.467490 Aug 24 11:39:52.461456 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 567/1151] 10.222.0.83 () {58 vars in 1416 bytes} [Wed Aug 24 11:39:51 2022] DELETE /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b/os-volume_attachments/c3af5a24-b7e7-48d3-be62-f757ee702955 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:39:54.635006 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=20 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:54.635769 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:39:54.639775 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fdc47703-d26f-4e4c-abf7-7554db285d17 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:54.640350 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fdc47703-d26f-4e4c-abf7-7554db285d17 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:54.646464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdc47703-d26f-4e4c-abf7-7554db285d17 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:54.650003 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdc47703-d26f-4e4c-abf7-7554db285d17 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:54.650003 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdc47703-d26f-4e4c-abf7-7554db285d17 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:54.650003 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdc47703-d26f-4e4c-abf7-7554db285d17 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:54.650003 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdc47703-d26f-4e4c-abf7-7554db285d17 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:54.650423 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdc47703-d26f-4e4c-abf7-7554db285d17 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:54.673967 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fdc47703-d26f-4e4c-abf7-7554db285d17 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:39:54.912618 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fdc47703-d26f-4e4c-abf7-7554db285d17 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "DELETE /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 204 len: 0 microversion: 2.1 time: 0.278764 Aug 24 11:39:54.913132 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 585/1152] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:39:54 2022] DELETE /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:39:54.922582 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-22005682-5ccf-4d3b-91cf-5fb45a7af38e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:54.926431 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-22005682-5ccf-4d3b-91cf-5fb45a7af38e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:54.930501 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-22005682-5ccf-4d3b-91cf-5fb45a7af38e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:54.930988 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-22005682-5ccf-4d3b-91cf-5fb45a7af38e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:54.931424 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-22005682-5ccf-4d3b-91cf-5fb45a7af38e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:54.932108 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-22005682-5ccf-4d3b-91cf-5fb45a7af38e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:54.932561 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-22005682-5ccf-4d3b-91cf-5fb45a7af38e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:54.933107 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-22005682-5ccf-4d3b-91cf-5fb45a7af38e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:54.997651 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:39:54.998085 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:39:55.064384 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-22005682-5ccf-4d3b-91cf-5fb45a7af38e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:55.072162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-22005682-5ccf-4d3b-91cf-5fb45a7af38e tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1513 microversion: 2.1 time: 0.154452 Aug 24 11:39:55.072741 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 568/1153] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:54 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:56.094454 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-99415fb2-9fa8-4aad-b4d8-59d975bbc82c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:56.095162 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-99415fb2-9fa8-4aad-b4d8-59d975bbc82c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:56.101595 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99415fb2-9fa8-4aad-b4d8-59d975bbc82c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:56.102114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99415fb2-9fa8-4aad-b4d8-59d975bbc82c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:56.102554 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99415fb2-9fa8-4aad-b4d8-59d975bbc82c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:56.103244 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99415fb2-9fa8-4aad-b4d8-59d975bbc82c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:56.103697 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99415fb2-9fa8-4aad-b4d8-59d975bbc82c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:56.104121 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99415fb2-9fa8-4aad-b4d8-59d975bbc82c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:56.336157 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-99415fb2-9fa8-4aad-b4d8-59d975bbc82c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:56.343829 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-99415fb2-9fa8-4aad-b4d8-59d975bbc82c tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1513 microversion: 2.1 time: 0.254293 Aug 24 11:39:56.344396 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 586/1154] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:56 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:57.364608 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b9c83a33-355e-4234-9496-f839fcdb2272 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:57.365290 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b9c83a33-355e-4234-9496-f839fcdb2272 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:57.371777 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b9c83a33-355e-4234-9496-f839fcdb2272 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:57.372257 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b9c83a33-355e-4234-9496-f839fcdb2272 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:57.372688 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b9c83a33-355e-4234-9496-f839fcdb2272 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:57.373380 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b9c83a33-355e-4234-9496-f839fcdb2272 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:57.373832 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b9c83a33-355e-4234-9496-f839fcdb2272 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:57.374280 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b9c83a33-355e-4234-9496-f839fcdb2272 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:57.510169 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b9c83a33-355e-4234-9496-f839fcdb2272 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:57.518504 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b9c83a33-355e-4234-9496-f839fcdb2272 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1513 microversion: 2.1 time: 0.157786 Aug 24 11:39:57.519084 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 569/1155] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:57 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:57.743921 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-b3e8dacf-538f-4bb6-9274-1df9692f5e5f req-5095d163-6eee-4be2-aa75-b205e0b463a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453869d9-bb48-445a-9a0a-eda74447652b", "name": "network-vif-deleted", "tag": "ca6f0432-5fd8-461f-83d1-c829288dc4c1"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:39:57.754843 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b3e8dacf-538f-4bb6-9274-1df9692f5e5f req-5095d163-6eee-4be2-aa75-b205e0b463a9 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:57.757268 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b3e8dacf-538f-4bb6-9274-1df9692f5e5f req-5095d163-6eee-4be2-aa75-b205e0b463a9 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:57.757268 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b3e8dacf-538f-4bb6-9274-1df9692f5e5f req-5095d163-6eee-4be2-aa75-b205e0b463a9 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:57.767684 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-b3e8dacf-538f-4bb6-9274-1df9692f5e5f req-5095d163-6eee-4be2-aa75-b205e0b463a9 service nova] Creating event network-vif-deleted:ca6f0432-5fd8-461f-83d1-c829288dc4c1 for instance 453869d9-bb48-445a-9a0a-eda74447652b on hv-cinder-85427 Aug 24 11:39:57.772910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-b3e8dacf-538f-4bb6-9274-1df9692f5e5f req-5095d163-6eee-4be2-aa75-b205e0b463a9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032529 Aug 24 11:39:57.773500 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 587/1156] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:39:58.540775 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3097d4c8-3bf2-48b0-aafa-3a10123316e0 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:58.541391 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3097d4c8-3bf2-48b0-aafa-3a10123316e0 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:58.548524 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3097d4c8-3bf2-48b0-aafa-3a10123316e0 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:58.549006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3097d4c8-3bf2-48b0-aafa-3a10123316e0 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:58.549453 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3097d4c8-3bf2-48b0-aafa-3a10123316e0 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:58.550188 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3097d4c8-3bf2-48b0-aafa-3a10123316e0 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:58.550641 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3097d4c8-3bf2-48b0-aafa-3a10123316e0 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:58.551071 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3097d4c8-3bf2-48b0-aafa-3a10123316e0 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:58.584943 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3097d4c8-3bf2-48b0-aafa-3a10123316e0 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:58.585386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3097d4c8-3bf2-48b0-aafa-3a10123316e0 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:58.585821 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3097d4c8-3bf2-48b0-aafa-3a10123316e0 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:58.586351 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-3097d4c8-3bf2-48b0-aafa-3a10123316e0 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lazy-loading 'fault' on Instance uuid 453869d9-bb48-445a-9a0a-eda74447652b {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:39:58.630233 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3097d4c8-3bf2-48b0-aafa-3a10123316e0 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e40e7790fe94c388cb206aab7c94734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3583d4d34a634ea9a30c1f96ba70a664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:39:58.638654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3097d4c8-3bf2-48b0-aafa-3a10123316e0 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 200 len: 1309 microversion: 2.1 time: 0.101847 Aug 24 11:39:58.639254 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 570/1157] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:58 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:39:59.660952 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c06c96b0-4f10-47a0-844e-e41e3cc0ec85 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:39:59.661601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c06c96b0-4f10-47a0-844e-e41e3cc0ec85 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] [instance: 453869d9-bb48-445a-9a0a-eda74447652b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:39:59.667901 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c06c96b0-4f10-47a0-844e-e41e3cc0ec85 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:59.668386 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c06c96b0-4f10-47a0-844e-e41e3cc0ec85 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:59.668822 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c06c96b0-4f10-47a0-844e-e41e3cc0ec85 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:59.669511 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c06c96b0-4f10-47a0-844e-e41e3cc0ec85 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:39:59.669991 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c06c96b0-4f10-47a0-844e-e41e3cc0ec85 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:39:59.672534 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c06c96b0-4f10-47a0-844e-e41e3cc0ec85 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:39:59.684409 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-c06c96b0-4f10-47a0-844e-e41e3cc0ec85 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] HTTP exception thrown: Instance 453869d9-bb48-445a-9a0a-eda74447652b could not be found. Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c06c96b0-4f10-47a0-844e-e41e3cc0ec85 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Request method failure captured: Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b HTTP/1.1 Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBg2A3Y4rw27o9YizrmHDx4r0Tu905CjWGSjKes7e-bx9c-fL2E_0xMhz0RzPbWMVFkqX7LbUglVinSwgqXD6ONNfpfy5NEw-lENpSXEgQvF3NWNM-2bG_MKq1D5KYx0Rl9ArNuRwqdI05J2Sz3hwazv9SryQ8t6jDsS28bToCD5Lhr0 Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 3583d4d34a634ea9a30c1f96ba70a664 Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesSnapshotTestJSON-57851825 Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:39:59.686079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:39:59.688273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3583d4d34a634ea9a30c1f96ba70a664"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3583d4d34a634ea9a30c1f96ba70a664"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3583d4d34a634ea9a30c1f96ba70a664", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3583d4d34a634ea9a30c1f96ba70a664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:39:59.688273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesSnapshotTestJSON-57851825 Aug 24 11:39:59.688273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 3583d4d34a634ea9a30c1f96ba70a664 Aug 24 11:39:59.688273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-57851825 Aug 24 11:39:59.688273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesSnapshotTestJSON-57851825-project Aug 24 11:39:59.688273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:39:59.688273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:39:59.688273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 2e40e7790fe94c388cb206aab7c94734 Aug 24 11:39:59.688273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesSnapshotTestJSON-57851825-project Aug 24 11:39:59.688273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:39:59.688273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 453869d9-bb48-445a-9a0a-eda74447652b could not be found. Aug 24 11:39:59.688273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '453869d9-bb48-445a-9a0a-eda74447652b'} Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 453869d9-bb48-445a-9a0a-eda74447652b could not be found. Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:39:59.689348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 453869d9-bb48-445a-9a0a-eda74447652b could not be found. Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 453869d9-bb48-445a-9a0a-eda74447652b could not be found. Aug 24 11:39:59.691127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:39:59.692534 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c06c96b0-4f10-47a0-844e-e41e3cc0ec85 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] Returning 404 to user: Instance 453869d9-bb48-445a-9a0a-eda74447652b could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:39:59.692534 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c06c96b0-4f10-47a0-844e-e41e3cc0ec85 tempest-VolumesSnapshotTestJSON-57851825 tempest-VolumesSnapshotTestJSON-57851825-project] 10.222.0.83 "GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b" status: 404 len: 111 microversion: 2.1 time: 0.031557 Aug 24 11:39:59.692534 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 588/1158] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:39:59 2022] GET /compute/v2.1/servers/453869d9-bb48-445a-9a0a-eda74447652b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:40:04.555915 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-933aa514-ab68-48a6-850b-f51723af4782 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:04.556470 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-933aa514-ab68-48a6-850b-f51723af4782 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:04.562942 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-933aa514-ab68-48a6-850b-f51723af4782 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:04.563427 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-933aa514-ab68-48a6-850b-f51723af4782 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:04.564495 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-933aa514-ab68-48a6-850b-f51723af4782 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:04.565225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-933aa514-ab68-48a6-850b-f51723af4782 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:04.565708 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-933aa514-ab68-48a6-850b-f51723af4782 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:04.566156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-933aa514-ab68-48a6-850b-f51723af4782 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:04.590079 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-933aa514-ab68-48a6-850b-f51723af4782 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7/ips" status: 200 len: 152 microversion: 2.20 time: 0.145144 Aug 24 11:40:04.591034 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 571/1159] 10.222.0.83 () {60 vars in 1289 bytes} [Wed Aug 24 11:40:04 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7/ips => generated 152 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 11:40:07.892047 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cf2030cd-2f7e-4b35-965f-156d25890fbe tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:07.893339 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cf2030cd-2f7e-4b35-965f-156d25890fbe tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:07.899796 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf2030cd-2f7e-4b35-965f-156d25890fbe tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:07.902853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf2030cd-2f7e-4b35-965f-156d25890fbe tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:07.902853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf2030cd-2f7e-4b35-965f-156d25890fbe tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:07.902853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf2030cd-2f7e-4b35-965f-156d25890fbe tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:07.902853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf2030cd-2f7e-4b35-965f-156d25890fbe tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:07.903233 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf2030cd-2f7e-4b35-965f-156d25890fbe tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:07.933405 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-cf2030cd-2f7e-4b35-965f-156d25890fbe tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lazy-loading 'flavor' on Instance uuid 32c3349f-3561-4764-94db-a6a5189f5ff7 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:40:08.491492 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cf2030cd-2f7e-4b35-965f-156d25890fbe tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "POST /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7/action" status: 202 len: 0 microversion: 2.20 time: 0.603120 Aug 24 11:40:08.492125 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 589/1160] 10.222.0.83 () {62 vars in 1319 bytes} [Wed Aug 24 11:40:07 2022] POST /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:40:08.500800 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-35eb96b7-bd89-4e77-b8b9-e7224391d7f6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:08.510964 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-35eb96b7-bd89-4e77-b8b9-e7224391d7f6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:08.510964 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-35eb96b7-bd89-4e77-b8b9-e7224391d7f6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:08.510964 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-35eb96b7-bd89-4e77-b8b9-e7224391d7f6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:08.510964 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-35eb96b7-bd89-4e77-b8b9-e7224391d7f6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:08.512801 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-35eb96b7-bd89-4e77-b8b9-e7224391d7f6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:08.512801 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-35eb96b7-bd89-4e77-b8b9-e7224391d7f6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:08.512801 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-35eb96b7-bd89-4e77-b8b9-e7224391d7f6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:08.660573 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-35eb96b7-bd89-4e77-b8b9-e7224391d7f6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:08.669450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-35eb96b7-bd89-4e77-b8b9-e7224391d7f6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:08.671155 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-35eb96b7-bd89-4e77-b8b9-e7224391d7f6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:08.672242 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-35eb96b7-bd89-4e77-b8b9-e7224391d7f6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.175490 Aug 24 11:40:08.672785 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 572/1161] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:08 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:09.697750 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8e5cb51e-fd2c-44f4-bd02-b41ca1187ec9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:09.698499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8e5cb51e-fd2c-44f4-bd02-b41ca1187ec9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:09.705599 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e5cb51e-fd2c-44f4-bd02-b41ca1187ec9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:09.706118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e5cb51e-fd2c-44f4-bd02-b41ca1187ec9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:09.706557 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e5cb51e-fd2c-44f4-bd02-b41ca1187ec9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:09.707254 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e5cb51e-fd2c-44f4-bd02-b41ca1187ec9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:09.707711 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e5cb51e-fd2c-44f4-bd02-b41ca1187ec9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:09.708137 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e5cb51e-fd2c-44f4-bd02-b41ca1187ec9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:09.841996 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8e5cb51e-fd2c-44f4-bd02-b41ca1187ec9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:09.850817 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8e5cb51e-fd2c-44f4-bd02-b41ca1187ec9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:09.852329 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8e5cb51e-fd2c-44f4-bd02-b41ca1187ec9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:09.853497 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8e5cb51e-fd2c-44f4-bd02-b41ca1187ec9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.160625 Aug 24 11:40:09.854091 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 590/1162] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:09 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:10.875814 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-05c9f3dc-d90b-41b6-aadc-39f61726ac17 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:10.876418 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-05c9f3dc-d90b-41b6-aadc-39f61726ac17 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:10.883671 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-05c9f3dc-d90b-41b6-aadc-39f61726ac17 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:10.884147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-05c9f3dc-d90b-41b6-aadc-39f61726ac17 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:10.884572 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-05c9f3dc-d90b-41b6-aadc-39f61726ac17 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:10.885264 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-05c9f3dc-d90b-41b6-aadc-39f61726ac17 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:10.885692 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-05c9f3dc-d90b-41b6-aadc-39f61726ac17 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:10.886130 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-05c9f3dc-d90b-41b6-aadc-39f61726ac17 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:11.021743 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-05c9f3dc-d90b-41b6-aadc-39f61726ac17 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:11.029968 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-05c9f3dc-d90b-41b6-aadc-39f61726ac17 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:11.037808 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-05c9f3dc-d90b-41b6-aadc-39f61726ac17 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:11.037808 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-05c9f3dc-d90b-41b6-aadc-39f61726ac17 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.160838 Aug 24 11:40:11.037808 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 573/1163] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:10 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:12.055629 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f5dd289e-669c-4566-b2b9-15c938bf1b3b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:12.056166 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f5dd289e-669c-4566-b2b9-15c938bf1b3b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:12.062818 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5dd289e-669c-4566-b2b9-15c938bf1b3b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:12.063301 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5dd289e-669c-4566-b2b9-15c938bf1b3b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:12.063738 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5dd289e-669c-4566-b2b9-15c938bf1b3b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:12.064927 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5dd289e-669c-4566-b2b9-15c938bf1b3b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:12.065377 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5dd289e-669c-4566-b2b9-15c938bf1b3b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:12.065968 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5dd289e-669c-4566-b2b9-15c938bf1b3b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:12.196960 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f5dd289e-669c-4566-b2b9-15c938bf1b3b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:12.205734 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f5dd289e-669c-4566-b2b9-15c938bf1b3b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:12.207265 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f5dd289e-669c-4566-b2b9-15c938bf1b3b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:12.208419 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f5dd289e-669c-4566-b2b9-15c938bf1b3b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.156913 Aug 24 11:40:12.208982 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 591/1164] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:12 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:13.230790 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-37ae60c3-5b14-4f1a-8ebb-3eee9af8e81f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:13.231414 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-37ae60c3-5b14-4f1a-8ebb-3eee9af8e81f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:13.237912 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37ae60c3-5b14-4f1a-8ebb-3eee9af8e81f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:13.238395 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37ae60c3-5b14-4f1a-8ebb-3eee9af8e81f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:13.238860 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37ae60c3-5b14-4f1a-8ebb-3eee9af8e81f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:13.239548 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37ae60c3-5b14-4f1a-8ebb-3eee9af8e81f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:13.239996 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37ae60c3-5b14-4f1a-8ebb-3eee9af8e81f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:13.240418 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-37ae60c3-5b14-4f1a-8ebb-3eee9af8e81f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:13.380388 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-37ae60c3-5b14-4f1a-8ebb-3eee9af8e81f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:13.388682 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-37ae60c3-5b14-4f1a-8ebb-3eee9af8e81f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:13.390225 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-37ae60c3-5b14-4f1a-8ebb-3eee9af8e81f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:13.391379 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-37ae60c3-5b14-4f1a-8ebb-3eee9af8e81f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.165263 Aug 24 11:40:13.391943 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 574/1165] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:13 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:14.415471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d21ee0ef-0d30-4418-9d25-53f92c5b88dc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:14.416086 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d21ee0ef-0d30-4418-9d25-53f92c5b88dc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:14.422217 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d21ee0ef-0d30-4418-9d25-53f92c5b88dc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:14.422758 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d21ee0ef-0d30-4418-9d25-53f92c5b88dc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:14.423137 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d21ee0ef-0d30-4418-9d25-53f92c5b88dc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:14.424517 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d21ee0ef-0d30-4418-9d25-53f92c5b88dc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:14.424975 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d21ee0ef-0d30-4418-9d25-53f92c5b88dc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:14.425400 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d21ee0ef-0d30-4418-9d25-53f92c5b88dc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:14.561501 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d21ee0ef-0d30-4418-9d25-53f92c5b88dc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:14.569839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d21ee0ef-0d30-4418-9d25-53f92c5b88dc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:14.571365 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d21ee0ef-0d30-4418-9d25-53f92c5b88dc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:14.572586 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d21ee0ef-0d30-4418-9d25-53f92c5b88dc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.161563 Aug 24 11:40:14.573146 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 592/1166] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:14 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:40:15.594567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f25a8504-df0f-4783-9fa6-d37394476cab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:15.595158 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f25a8504-df0f-4783-9fa6-d37394476cab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:15.601698 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f25a8504-df0f-4783-9fa6-d37394476cab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:15.602222 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f25a8504-df0f-4783-9fa6-d37394476cab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:15.605016 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f25a8504-df0f-4783-9fa6-d37394476cab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:15.605016 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f25a8504-df0f-4783-9fa6-d37394476cab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:15.605016 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f25a8504-df0f-4783-9fa6-d37394476cab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:15.605016 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f25a8504-df0f-4783-9fa6-d37394476cab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:15.737374 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f25a8504-df0f-4783-9fa6-d37394476cab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:15.745600 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f25a8504-df0f-4783-9fa6-d37394476cab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:15.747125 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f25a8504-df0f-4783-9fa6-d37394476cab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:15.748277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f25a8504-df0f-4783-9fa6-d37394476cab tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.157686 Aug 24 11:40:15.748839 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 575/1167] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:15 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:16.772549 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b7c0e8ea-f7d4-4510-a8c5-1e1bc041d735 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:16.773092 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b7c0e8ea-f7d4-4510-a8c5-1e1bc041d735 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:16.779543 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7c0e8ea-f7d4-4510-a8c5-1e1bc041d735 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:16.780031 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7c0e8ea-f7d4-4510-a8c5-1e1bc041d735 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:16.780471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7c0e8ea-f7d4-4510-a8c5-1e1bc041d735 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:16.781159 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7c0e8ea-f7d4-4510-a8c5-1e1bc041d735 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:16.781611 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7c0e8ea-f7d4-4510-a8c5-1e1bc041d735 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:16.782064 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7c0e8ea-f7d4-4510-a8c5-1e1bc041d735 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:16.909114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b7c0e8ea-f7d4-4510-a8c5-1e1bc041d735 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:16.917319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b7c0e8ea-f7d4-4510-a8c5-1e1bc041d735 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:16.918869 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b7c0e8ea-f7d4-4510-a8c5-1e1bc041d735 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:16.920078 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b7c0e8ea-f7d4-4510-a8c5-1e1bc041d735 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.152230 Aug 24 11:40:16.920642 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 593/1168] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:16 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:17.943208 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a9a34815-b8b0-43f8-9481-5ad3be3f2cb7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:17.943784 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a9a34815-b8b0-43f8-9481-5ad3be3f2cb7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:17.950312 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a9a34815-b8b0-43f8-9481-5ad3be3f2cb7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:17.950761 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a9a34815-b8b0-43f8-9481-5ad3be3f2cb7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:17.951198 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a9a34815-b8b0-43f8-9481-5ad3be3f2cb7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:17.951922 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a9a34815-b8b0-43f8-9481-5ad3be3f2cb7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:17.952371 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a9a34815-b8b0-43f8-9481-5ad3be3f2cb7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:17.952796 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a9a34815-b8b0-43f8-9481-5ad3be3f2cb7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:18.093392 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a9a34815-b8b0-43f8-9481-5ad3be3f2cb7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:18.101649 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a9a34815-b8b0-43f8-9481-5ad3be3f2cb7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:18.103182 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a9a34815-b8b0-43f8-9481-5ad3be3f2cb7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:18.104334 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a9a34815-b8b0-43f8-9481-5ad3be3f2cb7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.165132 Aug 24 11:40:18.104881 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 576/1169] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:17 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:19.126707 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-95053da1-5755-47cd-8009-deb45da92153 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:19.127234 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-95053da1-5755-47cd-8009-deb45da92153 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:19.134247 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-95053da1-5755-47cd-8009-deb45da92153 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:19.134834 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-95053da1-5755-47cd-8009-deb45da92153 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:19.135142 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-95053da1-5755-47cd-8009-deb45da92153 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:19.135840 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-95053da1-5755-47cd-8009-deb45da92153 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:19.136285 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-95053da1-5755-47cd-8009-deb45da92153 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:19.136704 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-95053da1-5755-47cd-8009-deb45da92153 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:19.267039 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-95053da1-5755-47cd-8009-deb45da92153 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:19.275732 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-95053da1-5755-47cd-8009-deb45da92153 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:19.277241 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-95053da1-5755-47cd-8009-deb45da92153 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:19.278463 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-95053da1-5755-47cd-8009-deb45da92153 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.156163 Aug 24 11:40:19.279029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 594/1170] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:19 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:20.301090 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d78a6523-a2d8-4762-b1b9-a917b4deef69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:20.301715 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d78a6523-a2d8-4762-b1b9-a917b4deef69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:20.308139 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d78a6523-a2d8-4762-b1b9-a917b4deef69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:20.308617 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d78a6523-a2d8-4762-b1b9-a917b4deef69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:20.309043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d78a6523-a2d8-4762-b1b9-a917b4deef69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:20.309723 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d78a6523-a2d8-4762-b1b9-a917b4deef69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:20.310206 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d78a6523-a2d8-4762-b1b9-a917b4deef69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:20.310624 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d78a6523-a2d8-4762-b1b9-a917b4deef69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:20.446468 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d78a6523-a2d8-4762-b1b9-a917b4deef69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:20.454772 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d78a6523-a2d8-4762-b1b9-a917b4deef69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:20.456333 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d78a6523-a2d8-4762-b1b9-a917b4deef69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:20.457482 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d78a6523-a2d8-4762-b1b9-a917b4deef69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.160868 Aug 24 11:40:20.458072 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 577/1171] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:20 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:21.480426 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f78bcd14-2481-4924-a591-a43610518a87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:21.481005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f78bcd14-2481-4924-a591-a43610518a87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:21.487997 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f78bcd14-2481-4924-a591-a43610518a87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:21.488487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f78bcd14-2481-4924-a591-a43610518a87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:21.488932 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f78bcd14-2481-4924-a591-a43610518a87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:21.489629 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f78bcd14-2481-4924-a591-a43610518a87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:21.490113 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f78bcd14-2481-4924-a591-a43610518a87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:21.490541 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f78bcd14-2481-4924-a591-a43610518a87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:21.628065 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f78bcd14-2481-4924-a591-a43610518a87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:21.637122 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f78bcd14-2481-4924-a591-a43610518a87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:21.638718 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f78bcd14-2481-4924-a591-a43610518a87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:21.642486 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f78bcd14-2481-4924-a591-a43610518a87 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.163645 Aug 24 11:40:21.642486 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 595/1172] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:21 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:22.662324 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9ca2d4b9-29da-417c-bbb8-bdc83c3e00ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:22.662936 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9ca2d4b9-29da-417c-bbb8-bdc83c3e00ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:22.665550 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=25 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:22.670361 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ca2d4b9-29da-417c-bbb8-bdc83c3e00ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:22.670856 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ca2d4b9-29da-417c-bbb8-bdc83c3e00ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:22.671293 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ca2d4b9-29da-417c-bbb8-bdc83c3e00ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:22.672055 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ca2d4b9-29da-417c-bbb8-bdc83c3e00ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:22.672449 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ca2d4b9-29da-417c-bbb8-bdc83c3e00ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:22.672874 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9ca2d4b9-29da-417c-bbb8-bdc83c3e00ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:22.676897 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:22.803625 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9ca2d4b9-29da-417c-bbb8-bdc83c3e00ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:22.811895 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9ca2d4b9-29da-417c-bbb8-bdc83c3e00ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:22.813407 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9ca2d4b9-29da-417c-bbb8-bdc83c3e00ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:22.814656 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9ca2d4b9-29da-417c-bbb8-bdc83c3e00ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.156149 Aug 24 11:40:22.815713 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 578/1173] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:22 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:23.838280 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2149b6c9-21fe-43a0-b953-a0463e81b41f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:23.840396 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2149b6c9-21fe-43a0-b953-a0463e81b41f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:23.844874 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2149b6c9-21fe-43a0-b953-a0463e81b41f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:23.845364 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2149b6c9-21fe-43a0-b953-a0463e81b41f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:23.845799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2149b6c9-21fe-43a0-b953-a0463e81b41f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:23.847123 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2149b6c9-21fe-43a0-b953-a0463e81b41f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:23.847578 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2149b6c9-21fe-43a0-b953-a0463e81b41f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:23.848005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2149b6c9-21fe-43a0-b953-a0463e81b41f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:23.979216 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2149b6c9-21fe-43a0-b953-a0463e81b41f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:23.987535 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2149b6c9-21fe-43a0-b953-a0463e81b41f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:23.989040 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2149b6c9-21fe-43a0-b953-a0463e81b41f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:23.990198 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2149b6c9-21fe-43a0-b953-a0463e81b41f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.156372 Aug 24 11:40:23.990756 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 596/1174] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:23 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:25.015021 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ea2282ce-84c4-4388-896e-09e08b42637a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:25.015576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ea2282ce-84c4-4388-896e-09e08b42637a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:25.022967 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ea2282ce-84c4-4388-896e-09e08b42637a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:25.023457 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ea2282ce-84c4-4388-896e-09e08b42637a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:25.023896 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ea2282ce-84c4-4388-896e-09e08b42637a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:25.024589 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ea2282ce-84c4-4388-896e-09e08b42637a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:25.025046 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ea2282ce-84c4-4388-896e-09e08b42637a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:25.025477 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ea2282ce-84c4-4388-896e-09e08b42637a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:25.160232 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ea2282ce-84c4-4388-896e-09e08b42637a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:25.168583 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ea2282ce-84c4-4388-896e-09e08b42637a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:25.170119 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ea2282ce-84c4-4388-896e-09e08b42637a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:25.171355 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ea2282ce-84c4-4388-896e-09e08b42637a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.160642 Aug 24 11:40:25.171854 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 579/1175] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:25 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:26.194674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b63dc719-9d64-47f8-ab3b-4d0d05283bb9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:26.195275 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b63dc719-9d64-47f8-ab3b-4d0d05283bb9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:26.197797 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:26.202569 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b63dc719-9d64-47f8-ab3b-4d0d05283bb9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:26.203048 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b63dc719-9d64-47f8-ab3b-4d0d05283bb9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:26.203476 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b63dc719-9d64-47f8-ab3b-4d0d05283bb9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:26.204162 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b63dc719-9d64-47f8-ab3b-4d0d05283bb9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:26.204603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b63dc719-9d64-47f8-ab3b-4d0d05283bb9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:26.205015 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b63dc719-9d64-47f8-ab3b-4d0d05283bb9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:26.208148 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:26.346786 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b63dc719-9d64-47f8-ab3b-4d0d05283bb9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:26.357959 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b63dc719-9d64-47f8-ab3b-4d0d05283bb9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:26.360289 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b63dc719-9d64-47f8-ab3b-4d0d05283bb9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:26.363565 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b63dc719-9d64-47f8-ab3b-4d0d05283bb9 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1745 microversion: 2.20 time: 0.171009 Aug 24 11:40:26.363565 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 597/1176] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:26 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:27.385747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ce39a979-fd1f-479e-8b97-65b2518bb3a0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:27.386398 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ce39a979-fd1f-479e-8b97-65b2518bb3a0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:27.392901 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce39a979-fd1f-479e-8b97-65b2518bb3a0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:27.393386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce39a979-fd1f-479e-8b97-65b2518bb3a0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:27.393816 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce39a979-fd1f-479e-8b97-65b2518bb3a0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:27.394520 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce39a979-fd1f-479e-8b97-65b2518bb3a0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:27.394962 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce39a979-fd1f-479e-8b97-65b2518bb3a0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:27.395377 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ce39a979-fd1f-479e-8b97-65b2518bb3a0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:27.528231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ce39a979-fd1f-479e-8b97-65b2518bb3a0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:27.537083 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ce39a979-fd1f-479e-8b97-65b2518bb3a0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:27.538654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ce39a979-fd1f-479e-8b97-65b2518bb3a0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:27.539829 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ce39a979-fd1f-479e-8b97-65b2518bb3a0 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1745 microversion: 2.20 time: 0.158012 Aug 24 11:40:27.540409 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 580/1177] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:27 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:28.563570 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2a913d8f-7797-4c24-bcf8-cdfc0a945fdb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:28.564194 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2a913d8f-7797-4c24-bcf8-cdfc0a945fdb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:28.572124 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a913d8f-7797-4c24-bcf8-cdfc0a945fdb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:28.572603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a913d8f-7797-4c24-bcf8-cdfc0a945fdb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:28.573035 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a913d8f-7797-4c24-bcf8-cdfc0a945fdb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:28.573726 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a913d8f-7797-4c24-bcf8-cdfc0a945fdb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:28.574203 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a913d8f-7797-4c24-bcf8-cdfc0a945fdb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:28.574626 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a913d8f-7797-4c24-bcf8-cdfc0a945fdb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:28.710880 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2a913d8f-7797-4c24-bcf8-cdfc0a945fdb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:28.719114 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2a913d8f-7797-4c24-bcf8-cdfc0a945fdb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:28.722108 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2a913d8f-7797-4c24-bcf8-cdfc0a945fdb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:28.723382 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2a913d8f-7797-4c24-bcf8-cdfc0a945fdb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1745 microversion: 2.20 time: 0.163744 Aug 24 11:40:28.723971 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 598/1178] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:28 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:28.840550 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-91339265-b0fa-4baf-bbe8-4410fa5b3bac req-86e30b35-186b-47ba-bfc5-5d0a21ba485c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c3349f-3561-4764-94db-a6a5189f5ff7", "name": "network-vif-plugged", "status": "completed", "tag": "c52e1955-c066-4d21-adb0-3e0d49febdb3"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:28.851255 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-91339265-b0fa-4baf-bbe8-4410fa5b3bac req-86e30b35-186b-47ba-bfc5-5d0a21ba485c service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:28.851739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-91339265-b0fa-4baf-bbe8-4410fa5b3bac req-86e30b35-186b-47ba-bfc5-5d0a21ba485c service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:28.852191 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-91339265-b0fa-4baf-bbe8-4410fa5b3bac req-86e30b35-186b-47ba-bfc5-5d0a21ba485c service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:28.863737 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-91339265-b0fa-4baf-bbe8-4410fa5b3bac req-86e30b35-186b-47ba-bfc5-5d0a21ba485c service nova] Creating event network-vif-plugged:c52e1955-c066-4d21-adb0-3e0d49febdb3 for instance 32c3349f-3561-4764-94db-a6a5189f5ff7 on hv-cinder-85427 Aug 24 11:40:28.868886 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-91339265-b0fa-4baf-bbe8-4410fa5b3bac req-86e30b35-186b-47ba-bfc5-5d0a21ba485c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031988 Aug 24 11:40:28.875519 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 581/1179] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:40:29.748935 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8959c499-18e2-4a15-b198-cf20e088476c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:29.749477 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8959c499-18e2-4a15-b198-cf20e088476c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:29.757339 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8959c499-18e2-4a15-b198-cf20e088476c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:29.757956 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8959c499-18e2-4a15-b198-cf20e088476c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:29.758349 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8959c499-18e2-4a15-b198-cf20e088476c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:29.759041 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8959c499-18e2-4a15-b198-cf20e088476c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:29.759552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8959c499-18e2-4a15-b198-cf20e088476c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:29.759981 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8959c499-18e2-4a15-b198-cf20e088476c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:29.891490 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8959c499-18e2-4a15-b198-cf20e088476c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:29.900370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8959c499-18e2-4a15-b198-cf20e088476c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:29.901962 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8959c499-18e2-4a15-b198-cf20e088476c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:29.903141 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8959c499-18e2-4a15-b198-cf20e088476c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1745 microversion: 2.20 time: 0.158800 Aug 24 11:40:29.903703 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 599/1180] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:29 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:30.927743 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5edd1e7d-88ae-41ba-9082-f38168666c4d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:30.928643 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5edd1e7d-88ae-41ba-9082-f38168666c4d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:30.936519 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5edd1e7d-88ae-41ba-9082-f38168666c4d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:30.937011 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5edd1e7d-88ae-41ba-9082-f38168666c4d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:30.937453 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5edd1e7d-88ae-41ba-9082-f38168666c4d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:30.938209 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5edd1e7d-88ae-41ba-9082-f38168666c4d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:30.940830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5edd1e7d-88ae-41ba-9082-f38168666c4d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:30.941306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5edd1e7d-88ae-41ba-9082-f38168666c4d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:31.148963 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5edd1e7d-88ae-41ba-9082-f38168666c4d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:31.157159 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5edd1e7d-88ae-41ba-9082-f38168666c4d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:31.158779 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5edd1e7d-88ae-41ba-9082-f38168666c4d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:31.159944 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5edd1e7d-88ae-41ba-9082-f38168666c4d tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1740 microversion: 2.20 time: 0.237717 Aug 24 11:40:31.160503 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 582/1181] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:30 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:32.185557 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8d6899e3-b315-4047-ac6a-d2c4cc5f666b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:32.186955 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8d6899e3-b315-4047-ac6a-d2c4cc5f666b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:32.195892 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8d6899e3-b315-4047-ac6a-d2c4cc5f666b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:32.196481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8d6899e3-b315-4047-ac6a-d2c4cc5f666b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:32.197102 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8d6899e3-b315-4047-ac6a-d2c4cc5f666b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:32.198080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8d6899e3-b315-4047-ac6a-d2c4cc5f666b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:32.198540 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8d6899e3-b315-4047-ac6a-d2c4cc5f666b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:32.199127 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8d6899e3-b315-4047-ac6a-d2c4cc5f666b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:32.354159 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8d6899e3-b315-4047-ac6a-d2c4cc5f666b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:32.363862 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8d6899e3-b315-4047-ac6a-d2c4cc5f666b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:32.367012 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8d6899e3-b315-4047-ac6a-d2c4cc5f666b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:32.368565 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8d6899e3-b315-4047-ac6a-d2c4cc5f666b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1740 microversion: 2.20 time: 0.188968 Aug 24 11:40:32.377977 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 600/1182] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:32 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:33.393569 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5f25db4b-66ac-4717-bb0b-41f833c7b7f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:33.394216 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5f25db4b-66ac-4717-bb0b-41f833c7b7f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:33.400990 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f25db4b-66ac-4717-bb0b-41f833c7b7f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:33.402991 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f25db4b-66ac-4717-bb0b-41f833c7b7f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:33.403720 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f25db4b-66ac-4717-bb0b-41f833c7b7f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:33.404946 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f25db4b-66ac-4717-bb0b-41f833c7b7f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:33.406069 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f25db4b-66ac-4717-bb0b-41f833c7b7f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:33.406475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5f25db4b-66ac-4717-bb0b-41f833c7b7f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:33.571985 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5f25db4b-66ac-4717-bb0b-41f833c7b7f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:33.584860 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5f25db4b-66ac-4717-bb0b-41f833c7b7f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:33.587925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5f25db4b-66ac-4717-bb0b-41f833c7b7f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:33.590540 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5f25db4b-66ac-4717-bb0b-41f833c7b7f7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1740 microversion: 2.20 time: 0.200230 Aug 24 11:40:33.591761 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 583/1183] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:33 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:40:34.620878 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9717de2a-9301-42c0-8d1e-5a6471d9fbc3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:34.622049 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9717de2a-9301-42c0-8d1e-5a6471d9fbc3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:34.628238 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9717de2a-9301-42c0-8d1e-5a6471d9fbc3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:34.629708 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9717de2a-9301-42c0-8d1e-5a6471d9fbc3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:34.630698 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9717de2a-9301-42c0-8d1e-5a6471d9fbc3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:34.630998 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9717de2a-9301-42c0-8d1e-5a6471d9fbc3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:34.631185 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9717de2a-9301-42c0-8d1e-5a6471d9fbc3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:34.631606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9717de2a-9301-42c0-8d1e-5a6471d9fbc3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:34.796898 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9717de2a-9301-42c0-8d1e-5a6471d9fbc3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:34.807685 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9717de2a-9301-42c0-8d1e-5a6471d9fbc3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:34.809647 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9717de2a-9301-42c0-8d1e-5a6471d9fbc3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:34.811274 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9717de2a-9301-42c0-8d1e-5a6471d9fbc3 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1740 microversion: 2.20 time: 0.194609 Aug 24 11:40:34.814244 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 601/1184] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:34 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:35.838374 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-51aed9c1-229f-4e27-bb19-ab243e0af3ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:35.839074 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-51aed9c1-229f-4e27-bb19-ab243e0af3ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:35.846156 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-51aed9c1-229f-4e27-bb19-ab243e0af3ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:35.847429 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-51aed9c1-229f-4e27-bb19-ab243e0af3ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:35.847873 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-51aed9c1-229f-4e27-bb19-ab243e0af3ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:35.848592 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-51aed9c1-229f-4e27-bb19-ab243e0af3ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:35.849099 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-51aed9c1-229f-4e27-bb19-ab243e0af3ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:35.849617 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-51aed9c1-229f-4e27-bb19-ab243e0af3ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:35.997582 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-51aed9c1-229f-4e27-bb19-ab243e0af3ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:36.007631 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-51aed9c1-229f-4e27-bb19-ab243e0af3ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:36.015916 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-51aed9c1-229f-4e27-bb19-ab243e0af3ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:36.015916 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-51aed9c1-229f-4e27-bb19-ab243e0af3ce tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1740 microversion: 2.20 time: 0.176043 Aug 24 11:40:36.026841 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 584/1185] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:35 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:37.035243 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-223f3b79-bd92-4df3-85d9-17c93aec4384 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:37.035859 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-223f3b79-bd92-4df3-85d9-17c93aec4384 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:37.042969 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-223f3b79-bd92-4df3-85d9-17c93aec4384 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:37.043538 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-223f3b79-bd92-4df3-85d9-17c93aec4384 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:37.043984 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-223f3b79-bd92-4df3-85d9-17c93aec4384 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:37.044723 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-223f3b79-bd92-4df3-85d9-17c93aec4384 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:37.045178 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-223f3b79-bd92-4df3-85d9-17c93aec4384 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:37.045601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-223f3b79-bd92-4df3-85d9-17c93aec4384 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:37.211131 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-223f3b79-bd92-4df3-85d9-17c93aec4384 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:37.219346 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-223f3b79-bd92-4df3-85d9-17c93aec4384 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:37.220836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-223f3b79-bd92-4df3-85d9-17c93aec4384 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:37.222023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-223f3b79-bd92-4df3-85d9-17c93aec4384 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1740 microversion: 2.20 time: 0.191553 Aug 24 11:40:37.222590 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 602/1186] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:37 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:38.250579 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-0280f926-b1ec-4db7-99bb-2c4d5699c1eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:38.251864 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-0280f926-b1ec-4db7-99bb-2c4d5699c1eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:38.262340 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0280f926-b1ec-4db7-99bb-2c4d5699c1eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:38.262836 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0280f926-b1ec-4db7-99bb-2c4d5699c1eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:38.263280 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0280f926-b1ec-4db7-99bb-2c4d5699c1eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:38.263987 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0280f926-b1ec-4db7-99bb-2c4d5699c1eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:38.264444 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0280f926-b1ec-4db7-99bb-2c4d5699c1eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:38.264959 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-0280f926-b1ec-4db7-99bb-2c4d5699c1eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:38.476036 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0280f926-b1ec-4db7-99bb-2c4d5699c1eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:38.486353 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0280f926-b1ec-4db7-99bb-2c4d5699c1eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:38.486698 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-0280f926-b1ec-4db7-99bb-2c4d5699c1eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:38.487810 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-0280f926-b1ec-4db7-99bb-2c4d5699c1eb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1740 microversion: 2.20 time: 0.242377 Aug 24 11:40:38.488417 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 585/1187] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:38 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:39.515984 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2ec52b60-cf1d-40dd-a235-e76807f4d554 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:39.516590 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2ec52b60-cf1d-40dd-a235-e76807f4d554 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:39.524268 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ec52b60-cf1d-40dd-a235-e76807f4d554 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:39.524768 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ec52b60-cf1d-40dd-a235-e76807f4d554 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:39.525205 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ec52b60-cf1d-40dd-a235-e76807f4d554 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:39.525976 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ec52b60-cf1d-40dd-a235-e76807f4d554 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:39.526517 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ec52b60-cf1d-40dd-a235-e76807f4d554 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:39.527078 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ec52b60-cf1d-40dd-a235-e76807f4d554 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:39.681033 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2ec52b60-cf1d-40dd-a235-e76807f4d554 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:39.690043 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2ec52b60-cf1d-40dd-a235-e76807f4d554 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:39.692002 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2ec52b60-cf1d-40dd-a235-e76807f4d554 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:39.694115 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2ec52b60-cf1d-40dd-a235-e76807f4d554 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1740 microversion: 2.20 time: 0.182101 Aug 24 11:40:39.695203 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 603/1188] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:39 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:40.716749 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-27b47c78-5525-4412-828b-1ce91b57af01 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:40.718027 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-27b47c78-5525-4412-828b-1ce91b57af01 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:40.725568 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-27b47c78-5525-4412-828b-1ce91b57af01 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:40.730021 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-27b47c78-5525-4412-828b-1ce91b57af01 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:40.730021 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-27b47c78-5525-4412-828b-1ce91b57af01 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:40.730021 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-27b47c78-5525-4412-828b-1ce91b57af01 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:40.730021 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-27b47c78-5525-4412-828b-1ce91b57af01 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:40.730390 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-27b47c78-5525-4412-828b-1ce91b57af01 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:40.875511 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-27b47c78-5525-4412-828b-1ce91b57af01 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:40.884319 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-27b47c78-5525-4412-828b-1ce91b57af01 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:40.885826 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-27b47c78-5525-4412-828b-1ce91b57af01 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:40.887052 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-27b47c78-5525-4412-828b-1ce91b57af01 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1740 microversion: 2.20 time: 0.174422 Aug 24 11:40:40.902181 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 586/1189] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:40 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:41.909596 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cdabb93f-a568-4af2-9d34-08513bb0949f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:41.910263 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cdabb93f-a568-4af2-9d34-08513bb0949f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:41.916807 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdabb93f-a568-4af2-9d34-08513bb0949f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:41.917291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdabb93f-a568-4af2-9d34-08513bb0949f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:41.917732 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdabb93f-a568-4af2-9d34-08513bb0949f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:41.918493 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdabb93f-a568-4af2-9d34-08513bb0949f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:41.918946 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdabb93f-a568-4af2-9d34-08513bb0949f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:41.919380 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdabb93f-a568-4af2-9d34-08513bb0949f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:42.054409 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cdabb93f-a568-4af2-9d34-08513bb0949f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:42.062975 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cdabb93f-a568-4af2-9d34-08513bb0949f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:42.064968 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cdabb93f-a568-4af2-9d34-08513bb0949f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:42.066148 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cdabb93f-a568-4af2-9d34-08513bb0949f tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1740 microversion: 2.20 time: 0.161066 Aug 24 11:40:42.066709 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 604/1190] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:41 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:43.088600 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3b681489-57f2-4a09-95c1-674a7524fc7a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:43.089238 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3b681489-57f2-4a09-95c1-674a7524fc7a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:43.095789 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3b681489-57f2-4a09-95c1-674a7524fc7a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:43.096272 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3b681489-57f2-4a09-95c1-674a7524fc7a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:43.096702 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3b681489-57f2-4a09-95c1-674a7524fc7a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:43.097400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3b681489-57f2-4a09-95c1-674a7524fc7a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:43.097844 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3b681489-57f2-4a09-95c1-674a7524fc7a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:43.098284 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3b681489-57f2-4a09-95c1-674a7524fc7a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:43.230304 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3b681489-57f2-4a09-95c1-674a7524fc7a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:43.239052 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3b681489-57f2-4a09-95c1-674a7524fc7a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:43.240571 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3b681489-57f2-4a09-95c1-674a7524fc7a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:43.241745 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3b681489-57f2-4a09-95c1-674a7524fc7a tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1722 microversion: 2.20 time: 0.157092 Aug 24 11:40:43.242372 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 587/1191] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:43 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:44.265139 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9f2b4fec-eb0c-41af-8f07-56d914e3f6bb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:44.265752 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9f2b4fec-eb0c-41af-8f07-56d914e3f6bb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:44.276092 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f2b4fec-eb0c-41af-8f07-56d914e3f6bb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:44.276582 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f2b4fec-eb0c-41af-8f07-56d914e3f6bb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:44.277019 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f2b4fec-eb0c-41af-8f07-56d914e3f6bb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:44.277724 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f2b4fec-eb0c-41af-8f07-56d914e3f6bb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:44.278204 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f2b4fec-eb0c-41af-8f07-56d914e3f6bb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:44.278624 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f2b4fec-eb0c-41af-8f07-56d914e3f6bb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:44.413028 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9f2b4fec-eb0c-41af-8f07-56d914e3f6bb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:44.421094 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9f2b4fec-eb0c-41af-8f07-56d914e3f6bb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:44.422635 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9f2b4fec-eb0c-41af-8f07-56d914e3f6bb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:44.423805 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9f2b4fec-eb0c-41af-8f07-56d914e3f6bb tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1722 microversion: 2.20 time: 0.162885 Aug 24 11:40:44.424376 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 605/1192] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:44 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:45.446953 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-da5cbb49-e019-40b9-88b2-e3f7d670a99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:45.447612 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-da5cbb49-e019-40b9-88b2-e3f7d670a99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:45.454501 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-da5cbb49-e019-40b9-88b2-e3f7d670a99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:45.455181 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-da5cbb49-e019-40b9-88b2-e3f7d670a99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:45.455400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-da5cbb49-e019-40b9-88b2-e3f7d670a99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:45.456091 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-da5cbb49-e019-40b9-88b2-e3f7d670a99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:45.457040 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-da5cbb49-e019-40b9-88b2-e3f7d670a99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:45.457457 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-da5cbb49-e019-40b9-88b2-e3f7d670a99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:45.591568 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-da5cbb49-e019-40b9-88b2-e3f7d670a99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:45.599901 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-da5cbb49-e019-40b9-88b2-e3f7d670a99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:45.601390 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-da5cbb49-e019-40b9-88b2-e3f7d670a99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:45.602595 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-da5cbb49-e019-40b9-88b2-e3f7d670a99c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1722 microversion: 2.20 time: 0.159858 Aug 24 11:40:45.603144 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 588/1193] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:45 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:40:46.626508 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-27ae1147-6298-4e04-8692-32bda05d0539 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:46.627069 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-27ae1147-6298-4e04-8692-32bda05d0539 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:46.633923 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-27ae1147-6298-4e04-8692-32bda05d0539 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:46.634414 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-27ae1147-6298-4e04-8692-32bda05d0539 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:46.634854 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-27ae1147-6298-4e04-8692-32bda05d0539 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:46.635557 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-27ae1147-6298-4e04-8692-32bda05d0539 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:46.636013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-27ae1147-6298-4e04-8692-32bda05d0539 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:46.636435 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-27ae1147-6298-4e04-8692-32bda05d0539 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:46.766886 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-27ae1147-6298-4e04-8692-32bda05d0539 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:46.776651 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-27ae1147-6298-4e04-8692-32bda05d0539 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:46.777582 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-27ae1147-6298-4e04-8692-32bda05d0539 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:46.778837 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-27ae1147-6298-4e04-8692-32bda05d0539 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1665 microversion: 2.20 time: 0.157041 Aug 24 11:40:46.779408 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 606/1194] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:46 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:46.804112 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-1a3637f9-e8b1-4429-aa9b-fa0afacd3231 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87902723-831f-4576-aee1-8add7bea6349"}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:46.806692 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-1a3637f9-e8b1-4429-aa9b-fa0afacd3231 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:46.813275 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1a3637f9-e8b1-4429-aa9b-fa0afacd3231 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:46.813767 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1a3637f9-e8b1-4429-aa9b-fa0afacd3231 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:46.814318 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1a3637f9-e8b1-4429-aa9b-fa0afacd3231 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:46.815029 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1a3637f9-e8b1-4429-aa9b-fa0afacd3231 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:46.815486 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1a3637f9-e8b1-4429-aa9b-fa0afacd3231 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:46.816422 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-1a3637f9-e8b1-4429-aa9b-fa0afacd3231 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:46.915372 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-5f5d3c07-997f-464a-a12c-b0817a833bad req-62338cc7-3a80-41fa-a372-c4e6be9d969a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c3349f-3561-4764-94db-a6a5189f5ff7", "name": "network-vif-unplugged", "status": "completed", "tag": "c52e1955-c066-4d21-adb0-3e0d49febdb3"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:46.924799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5f5d3c07-997f-464a-a12c-b0817a833bad req-62338cc7-3a80-41fa-a372-c4e6be9d969a service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:46.925817 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5f5d3c07-997f-464a-a12c-b0817a833bad req-62338cc7-3a80-41fa-a372-c4e6be9d969a service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:46.926269 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5f5d3c07-997f-464a-a12c-b0817a833bad req-62338cc7-3a80-41fa-a372-c4e6be9d969a service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:46.937075 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.compute.server_external_events [req-5f5d3c07-997f-464a-a12c-b0817a833bad req-62338cc7-3a80-41fa-a372-c4e6be9d969a service nova] Unable to find a host for instance 32c3349f-3561-4764-94db-a6a5189f5ff7. Dropping event network-vif-unplugged {{(pid=121221) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 11:40:46.937982 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-5f5d3c07-997f-464a-a12c-b0817a833bad req-62338cc7-3a80-41fa-a372-c4e6be9d969a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026464 Aug 24 11:40:46.938555 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 607/1195] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 11:40:48.069812 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-1a3637f9-e8b1-4429-aa9b-fa0afacd3231 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "POST /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.270719 Aug 24 11:40:48.070464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 589/1196] 10.222.0.83 () {62 vars in 1364 bytes} [Wed Aug 24 11:40:46 2022] POST /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7/os-volume_attachments => generated 188 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 11:40:48.190453 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5def4e84-3d50-4fae-80ad-32b9aed1ec78 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:48.191506 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5def4e84-3d50-4fae-80ad-32b9aed1ec78 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:48.197790 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5def4e84-3d50-4fae-80ad-32b9aed1ec78 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:48.198293 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5def4e84-3d50-4fae-80ad-32b9aed1ec78 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:48.198719 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5def4e84-3d50-4fae-80ad-32b9aed1ec78 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:48.199391 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5def4e84-3d50-4fae-80ad-32b9aed1ec78 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:48.199836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5def4e84-3d50-4fae-80ad-32b9aed1ec78 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:48.200281 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5def4e84-3d50-4fae-80ad-32b9aed1ec78 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:48.859748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5def4e84-3d50-4fae-80ad-32b9aed1ec78 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "DELETE /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7/os-volume_attachments/87902723-831f-4576-aee1-8add7bea6349" status: 202 len: 0 microversion: 2.20 time: 0.673189 Aug 24 11:40:48.860375 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 608/1197] 10.222.0.83 () {60 vars in 1457 bytes} [Wed Aug 24 11:40:48 2022] DELETE /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7/os-volume_attachments/87902723-831f-4576-aee1-8add7bea6349 => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:40:48.920560 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-dd5e3411-4fa4-4894-a3ae-74f427458ee1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:40:48.921155 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-dd5e3411-4fa4-4894-a3ae-74f427458ee1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:48.929265 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dd5e3411-4fa4-4894-a3ae-74f427458ee1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:48.929773 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dd5e3411-4fa4-4894-a3ae-74f427458ee1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:48.930228 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dd5e3411-4fa4-4894-a3ae-74f427458ee1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:48.930907 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dd5e3411-4fa4-4894-a3ae-74f427458ee1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:48.931357 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dd5e3411-4fa4-4894-a3ae-74f427458ee1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:48.931769 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dd5e3411-4fa4-4894-a3ae-74f427458ee1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:48.974305 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-dd5e3411-4fa4-4894-a3ae-74f427458ee1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121222) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 11:40:49.354669 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-dd5e3411-4fa4-4894-a3ae-74f427458ee1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "POST /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7/action" status: 202 len: 0 microversion: 2.20 time: 0.437986 Aug 24 11:40:49.355450 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 590/1198] 10.222.0.83 () {62 vars in 1319 bytes} [Wed Aug 24 11:40:48 2022] POST /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:40:49.363546 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fe03b0a5-ad7c-4c58-aa57-5990dab69542 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:49.364221 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fe03b0a5-ad7c-4c58-aa57-5990dab69542 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:49.371415 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe03b0a5-ad7c-4c58-aa57-5990dab69542 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:49.371905 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe03b0a5-ad7c-4c58-aa57-5990dab69542 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:49.372338 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe03b0a5-ad7c-4c58-aa57-5990dab69542 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:49.373042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe03b0a5-ad7c-4c58-aa57-5990dab69542 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:49.373489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe03b0a5-ad7c-4c58-aa57-5990dab69542 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:49.373934 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe03b0a5-ad7c-4c58-aa57-5990dab69542 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:49.516033 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fe03b0a5-ad7c-4c58-aa57-5990dab69542 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:49.525008 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fe03b0a5-ad7c-4c58-aa57-5990dab69542 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:49.526530 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fe03b0a5-ad7c-4c58-aa57-5990dab69542 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:49.527702 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fe03b0a5-ad7c-4c58-aa57-5990dab69542 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1673 microversion: 2.20 time: 0.168146 Aug 24 11:40:49.528248 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 609/1199] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:49 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:50.552627 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-acc049a1-792d-4023-9b67-2f4fdbf8159e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:50.553243 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-acc049a1-792d-4023-9b67-2f4fdbf8159e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:50.559441 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-acc049a1-792d-4023-9b67-2f4fdbf8159e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:50.560230 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-acc049a1-792d-4023-9b67-2f4fdbf8159e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:50.560565 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-acc049a1-792d-4023-9b67-2f4fdbf8159e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:50.561521 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-acc049a1-792d-4023-9b67-2f4fdbf8159e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:50.562019 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-acc049a1-792d-4023-9b67-2f4fdbf8159e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:50.562448 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-acc049a1-792d-4023-9b67-2f4fdbf8159e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:50.692379 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-acc049a1-792d-4023-9b67-2f4fdbf8159e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:50.698924 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:50.702095 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-acc049a1-792d-4023-9b67-2f4fdbf8159e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:50.703735 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-acc049a1-792d-4023-9b67-2f4fdbf8159e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:50.705041 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-acc049a1-792d-4023-9b67-2f4fdbf8159e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1673 microversion: 2.20 time: 0.157854 Aug 24 11:40:50.705671 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 591/1200] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:50 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:51.728601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dd5589ca-1e69-4fac-b06d-f15853ba7a8b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:51.729176 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-dd5589ca-1e69-4fac-b06d-f15853ba7a8b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:51.735788 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd5589ca-1e69-4fac-b06d-f15853ba7a8b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:51.736262 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd5589ca-1e69-4fac-b06d-f15853ba7a8b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:51.736691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd5589ca-1e69-4fac-b06d-f15853ba7a8b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:51.737368 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd5589ca-1e69-4fac-b06d-f15853ba7a8b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:51.738337 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd5589ca-1e69-4fac-b06d-f15853ba7a8b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:51.738749 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd5589ca-1e69-4fac-b06d-f15853ba7a8b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:51.869855 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dd5589ca-1e69-4fac-b06d-f15853ba7a8b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:51.878222 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dd5589ca-1e69-4fac-b06d-f15853ba7a8b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:51.879710 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dd5589ca-1e69-4fac-b06d-f15853ba7a8b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:51.880853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-dd5589ca-1e69-4fac-b06d-f15853ba7a8b tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.156251 Aug 24 11:40:51.881410 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 610/1201] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:51 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:52.903845 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-cc5b92d0-a75a-4789-bdc1-7db04dc29d36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:52.904448 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-cc5b92d0-a75a-4789-bdc1-7db04dc29d36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:52.906911 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:52.911943 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cc5b92d0-a75a-4789-bdc1-7db04dc29d36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:52.912423 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cc5b92d0-a75a-4789-bdc1-7db04dc29d36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:52.912854 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cc5b92d0-a75a-4789-bdc1-7db04dc29d36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:52.913534 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cc5b92d0-a75a-4789-bdc1-7db04dc29d36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:52.914003 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cc5b92d0-a75a-4789-bdc1-7db04dc29d36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:52.914418 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cc5b92d0-a75a-4789-bdc1-7db04dc29d36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:53.053835 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-cc5b92d0-a75a-4789-bdc1-7db04dc29d36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:53.062369 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-cc5b92d0-a75a-4789-bdc1-7db04dc29d36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:53.063884 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-cc5b92d0-a75a-4789-bdc1-7db04dc29d36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:53.065071 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-cc5b92d0-a75a-4789-bdc1-7db04dc29d36 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.165373 Aug 24 11:40:53.066274 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 592/1202] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:52 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:54.088919 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-96506f30-7d95-4957-8b6d-f8b5ad69da69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:54.089534 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-96506f30-7d95-4957-8b6d-f8b5ad69da69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:54.096656 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96506f30-7d95-4957-8b6d-f8b5ad69da69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:54.097163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96506f30-7d95-4957-8b6d-f8b5ad69da69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:54.097617 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96506f30-7d95-4957-8b6d-f8b5ad69da69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:54.098366 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96506f30-7d95-4957-8b6d-f8b5ad69da69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:54.098860 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96506f30-7d95-4957-8b6d-f8b5ad69da69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:54.099284 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96506f30-7d95-4957-8b6d-f8b5ad69da69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:54.247391 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-96506f30-7d95-4957-8b6d-f8b5ad69da69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:54.250823 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:54.258034 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-96506f30-7d95-4957-8b6d-f8b5ad69da69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:54.259551 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-96506f30-7d95-4957-8b6d-f8b5ad69da69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:54.261894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-96506f30-7d95-4957-8b6d-f8b5ad69da69 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.176119 Aug 24 11:40:54.261894 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 611/1203] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:54 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:55.287125 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c600a238-ae4a-4cca-bdf2-cdecebfbbc64 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:55.288685 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c600a238-ae4a-4cca-bdf2-cdecebfbbc64 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:55.296004 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c600a238-ae4a-4cca-bdf2-cdecebfbbc64 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:55.296510 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c600a238-ae4a-4cca-bdf2-cdecebfbbc64 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:55.296950 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c600a238-ae4a-4cca-bdf2-cdecebfbbc64 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:55.297763 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c600a238-ae4a-4cca-bdf2-cdecebfbbc64 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:55.298261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c600a238-ae4a-4cca-bdf2-cdecebfbbc64 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:55.298670 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c600a238-ae4a-4cca-bdf2-cdecebfbbc64 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:55.445320 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c600a238-ae4a-4cca-bdf2-cdecebfbbc64 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:55.454048 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c600a238-ae4a-4cca-bdf2-cdecebfbbc64 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:55.455646 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c600a238-ae4a-4cca-bdf2-cdecebfbbc64 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:55.457335 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c600a238-ae4a-4cca-bdf2-cdecebfbbc64 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.176127 Aug 24 11:40:55.458153 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 593/1204] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:55 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:56.481014 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c930eb0f-d20f-4bd8-a3cf-adf0c344e2b7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:56.482664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c930eb0f-d20f-4bd8-a3cf-adf0c344e2b7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:56.490797 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c930eb0f-d20f-4bd8-a3cf-adf0c344e2b7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:56.495895 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c930eb0f-d20f-4bd8-a3cf-adf0c344e2b7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:56.495895 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c930eb0f-d20f-4bd8-a3cf-adf0c344e2b7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:56.495895 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c930eb0f-d20f-4bd8-a3cf-adf0c344e2b7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:56.495895 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c930eb0f-d20f-4bd8-a3cf-adf0c344e2b7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:56.496265 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c930eb0f-d20f-4bd8-a3cf-adf0c344e2b7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:56.636418 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c930eb0f-d20f-4bd8-a3cf-adf0c344e2b7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:56.646729 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c930eb0f-d20f-4bd8-a3cf-adf0c344e2b7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:56.649538 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c930eb0f-d20f-4bd8-a3cf-adf0c344e2b7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:56.651129 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c930eb0f-d20f-4bd8-a3cf-adf0c344e2b7 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.174421 Aug 24 11:40:56.652473 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 612/1205] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:56 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:57.675576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d8a6c7a5-49fb-4ebd-9783-591148fc8d32 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:57.676097 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d8a6c7a5-49fb-4ebd-9783-591148fc8d32 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:57.683441 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d8a6c7a5-49fb-4ebd-9783-591148fc8d32 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:57.683938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d8a6c7a5-49fb-4ebd-9783-591148fc8d32 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:57.684381 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d8a6c7a5-49fb-4ebd-9783-591148fc8d32 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:57.685087 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d8a6c7a5-49fb-4ebd-9783-591148fc8d32 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:57.685575 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d8a6c7a5-49fb-4ebd-9783-591148fc8d32 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:57.685992 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d8a6c7a5-49fb-4ebd-9783-591148fc8d32 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:57.837163 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d8a6c7a5-49fb-4ebd-9783-591148fc8d32 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:57.847428 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d8a6c7a5-49fb-4ebd-9783-591148fc8d32 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:57.849053 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d8a6c7a5-49fb-4ebd-9783-591148fc8d32 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:57.850351 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d8a6c7a5-49fb-4ebd-9783-591148fc8d32 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.179367 Aug 24 11:40:57.851283 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 594/1206] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:57 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:40:58.875196 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e62b09fc-ddd6-4c72-a09b-88c94a2e8847 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:40:58.875841 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e62b09fc-ddd6-4c72-a09b-88c94a2e8847 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:40:58.878594 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=32 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:40:58.884106 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e62b09fc-ddd6-4c72-a09b-88c94a2e8847 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:58.884549 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e62b09fc-ddd6-4c72-a09b-88c94a2e8847 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:58.884997 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e62b09fc-ddd6-4c72-a09b-88c94a2e8847 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:58.885770 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e62b09fc-ddd6-4c72-a09b-88c94a2e8847 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:40:58.886256 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e62b09fc-ddd6-4c72-a09b-88c94a2e8847 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:40:58.886685 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e62b09fc-ddd6-4c72-a09b-88c94a2e8847 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:40:59.032368 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e62b09fc-ddd6-4c72-a09b-88c94a2e8847 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:59.040913 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e62b09fc-ddd6-4c72-a09b-88c94a2e8847 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:59.042494 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e62b09fc-ddd6-4c72-a09b-88c94a2e8847 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:40:59.043730 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e62b09fc-ddd6-4c72-a09b-88c94a2e8847 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.172538 Aug 24 11:40:59.044495 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 613/1207] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:40:58 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:41:00.068393 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-ffc94f11-5eda-4cc5-a602-766a4d6dc5a8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:00.069222 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-ffc94f11-5eda-4cc5-a602-766a4d6dc5a8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:00.076008 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ffc94f11-5eda-4cc5-a602-766a4d6dc5a8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:00.076514 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ffc94f11-5eda-4cc5-a602-766a4d6dc5a8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:00.077000 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ffc94f11-5eda-4cc5-a602-766a4d6dc5a8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:00.077754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ffc94f11-5eda-4cc5-a602-766a4d6dc5a8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:00.078274 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ffc94f11-5eda-4cc5-a602-766a4d6dc5a8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:00.078705 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-ffc94f11-5eda-4cc5-a602-766a4d6dc5a8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:00.229921 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ffc94f11-5eda-4cc5-a602-766a4d6dc5a8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:00.241125 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ffc94f11-5eda-4cc5-a602-766a4d6dc5a8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:00.242801 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-ffc94f11-5eda-4cc5-a602-766a4d6dc5a8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:00.244284 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-ffc94f11-5eda-4cc5-a602-766a4d6dc5a8 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.181167 Aug 24 11:41:00.245155 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 595/1208] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:41:00 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:41:01.268420 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e5b0a426-4812-4521-9980-e13a5720116e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:01.270000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e5b0a426-4812-4521-9980-e13a5720116e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:01.276828 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5b0a426-4812-4521-9980-e13a5720116e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:01.280115 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5b0a426-4812-4521-9980-e13a5720116e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:01.280115 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5b0a426-4812-4521-9980-e13a5720116e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:01.280115 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5b0a426-4812-4521-9980-e13a5720116e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:01.280115 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5b0a426-4812-4521-9980-e13a5720116e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:01.280505 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5b0a426-4812-4521-9980-e13a5720116e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:01.428709 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e5b0a426-4812-4521-9980-e13a5720116e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:01.436455 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e5b0a426-4812-4521-9980-e13a5720116e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:01.438013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e5b0a426-4812-4521-9980-e13a5720116e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:01.439178 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e5b0a426-4812-4521-9980-e13a5720116e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.174791 Aug 24 11:41:01.439738 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 614/1209] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:41:01 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 11:41:02.462795 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-bf698e68-66cd-43c4-90dd-6d5e85fc2484 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:02.467142 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-bf698e68-66cd-43c4-90dd-6d5e85fc2484 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:02.469893 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bf698e68-66cd-43c4-90dd-6d5e85fc2484 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:02.470370 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bf698e68-66cd-43c4-90dd-6d5e85fc2484 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:02.470803 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bf698e68-66cd-43c4-90dd-6d5e85fc2484 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:02.471482 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bf698e68-66cd-43c4-90dd-6d5e85fc2484 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:02.471926 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bf698e68-66cd-43c4-90dd-6d5e85fc2484 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:02.472430 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bf698e68-66cd-43c4-90dd-6d5e85fc2484 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:02.604306 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-bf698e68-66cd-43c4-90dd-6d5e85fc2484 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:02.612682 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-bf698e68-66cd-43c4-90dd-6d5e85fc2484 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:02.614713 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-bf698e68-66cd-43c4-90dd-6d5e85fc2484 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:02.615904 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-bf698e68-66cd-43c4-90dd-6d5e85fc2484 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.157841 Aug 24 11:41:02.616471 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 596/1210] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:41:02 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:41:03.639405 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d1057bb9-c6b5-436a-8f1e-55562f07adef tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:03.640023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d1057bb9-c6b5-436a-8f1e-55562f07adef tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:03.647172 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d1057bb9-c6b5-436a-8f1e-55562f07adef tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:03.647653 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d1057bb9-c6b5-436a-8f1e-55562f07adef tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:03.648089 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d1057bb9-c6b5-436a-8f1e-55562f07adef tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:03.648783 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d1057bb9-c6b5-436a-8f1e-55562f07adef tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:03.649241 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d1057bb9-c6b5-436a-8f1e-55562f07adef tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:03.649665 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d1057bb9-c6b5-436a-8f1e-55562f07adef tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:03.779658 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d1057bb9-c6b5-436a-8f1e-55562f07adef tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:03.787711 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d1057bb9-c6b5-436a-8f1e-55562f07adef tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:03.789213 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d1057bb9-c6b5-436a-8f1e-55562f07adef tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:03.790389 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d1057bb9-c6b5-436a-8f1e-55562f07adef tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.154936 Aug 24 11:41:03.790946 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 615/1211] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:41:03 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:41:04.812716 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-91e7e1db-21c3-4f63-b031-8338f5a1d9f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:04.813310 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-91e7e1db-21c3-4f63-b031-8338f5a1d9f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:04.819905 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-91e7e1db-21c3-4f63-b031-8338f5a1d9f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:04.820517 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-91e7e1db-21c3-4f63-b031-8338f5a1d9f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:04.820958 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-91e7e1db-21c3-4f63-b031-8338f5a1d9f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:04.821655 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-91e7e1db-21c3-4f63-b031-8338f5a1d9f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:04.822148 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-91e7e1db-21c3-4f63-b031-8338f5a1d9f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:04.822573 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-91e7e1db-21c3-4f63-b031-8338f5a1d9f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:05.219121 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-91e7e1db-21c3-4f63-b031-8338f5a1d9f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:05.230152 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-91e7e1db-21c3-4f63-b031-8338f5a1d9f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:05.231658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-91e7e1db-21c3-4f63-b031-8338f5a1d9f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:05.232895 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-91e7e1db-21c3-4f63-b031-8338f5a1d9f5 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.424132 Aug 24 11:41:05.233707 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 597/1212] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:41:04 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:41:06.256956 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bd160c99-aad4-41b2-9cac-747a8b9a41ba tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:06.257621 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bd160c99-aad4-41b2-9cac-747a8b9a41ba tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:06.264162 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd160c99-aad4-41b2-9cac-747a8b9a41ba tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:06.264690 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd160c99-aad4-41b2-9cac-747a8b9a41ba tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:06.265219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd160c99-aad4-41b2-9cac-747a8b9a41ba tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:06.266024 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd160c99-aad4-41b2-9cac-747a8b9a41ba tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:06.268597 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd160c99-aad4-41b2-9cac-747a8b9a41ba tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:06.269052 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd160c99-aad4-41b2-9cac-747a8b9a41ba tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:06.412195 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bd160c99-aad4-41b2-9cac-747a8b9a41ba tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:06.420538 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bd160c99-aad4-41b2-9cac-747a8b9a41ba tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:06.422094 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bd160c99-aad4-41b2-9cac-747a8b9a41ba tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:06.423268 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bd160c99-aad4-41b2-9cac-747a8b9a41ba tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.170603 Aug 24 11:41:06.423846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 616/1213] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:41:06 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:41:07.454488 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d47ee5cf-5360-405a-a39c-5f88cd4d121e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:07.455100 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d47ee5cf-5360-405a-a39c-5f88cd4d121e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:07.461717 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d47ee5cf-5360-405a-a39c-5f88cd4d121e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:07.467778 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d47ee5cf-5360-405a-a39c-5f88cd4d121e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:07.467778 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d47ee5cf-5360-405a-a39c-5f88cd4d121e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:07.467778 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d47ee5cf-5360-405a-a39c-5f88cd4d121e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:07.467778 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d47ee5cf-5360-405a-a39c-5f88cd4d121e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:07.468198 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d47ee5cf-5360-405a-a39c-5f88cd4d121e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:07.593491 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d47ee5cf-5360-405a-a39c-5f88cd4d121e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:07.602298 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d47ee5cf-5360-405a-a39c-5f88cd4d121e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:07.603810 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d47ee5cf-5360-405a-a39c-5f88cd4d121e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:07.604977 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d47ee5cf-5360-405a-a39c-5f88cd4d121e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.154364 Aug 24 11:41:07.605539 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 598/1214] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:41:07 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:41:08.628438 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-92a40384-ba2b-4391-8645-845908be7b9c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:08.628992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-92a40384-ba2b-4391-8645-845908be7b9c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:08.636251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92a40384-ba2b-4391-8645-845908be7b9c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:08.636737 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92a40384-ba2b-4391-8645-845908be7b9c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:08.637179 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92a40384-ba2b-4391-8645-845908be7b9c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:08.637897 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92a40384-ba2b-4391-8645-845908be7b9c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:08.638364 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92a40384-ba2b-4391-8645-845908be7b9c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:08.638791 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-92a40384-ba2b-4391-8645-845908be7b9c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:08.770628 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-92a40384-ba2b-4391-8645-845908be7b9c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:08.778918 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-92a40384-ba2b-4391-8645-845908be7b9c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:08.780447 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-92a40384-ba2b-4391-8645-845908be7b9c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:08.781612 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-92a40384-ba2b-4391-8645-845908be7b9c tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.157475 Aug 24 11:41:08.782220 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 617/1215] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:41:08 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:41:09.803907 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-6c7b95ef-1674-4bb0-b30a-cabe9f109d20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:09.804521 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-6c7b95ef-1674-4bb0-b30a-cabe9f109d20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:09.810473 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6c7b95ef-1674-4bb0-b30a-cabe9f109d20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:09.810883 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6c7b95ef-1674-4bb0-b30a-cabe9f109d20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:09.811312 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6c7b95ef-1674-4bb0-b30a-cabe9f109d20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:09.811991 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6c7b95ef-1674-4bb0-b30a-cabe9f109d20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:09.812433 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6c7b95ef-1674-4bb0-b30a-cabe9f109d20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:09.812848 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-6c7b95ef-1674-4bb0-b30a-cabe9f109d20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:09.942456 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6c7b95ef-1674-4bb0-b30a-cabe9f109d20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:09.951531 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6c7b95ef-1674-4bb0-b30a-cabe9f109d20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:09.953067 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-6c7b95ef-1674-4bb0-b30a-cabe9f109d20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:09.954379 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-6c7b95ef-1674-4bb0-b30a-cabe9f109d20 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.154477 Aug 24 11:41:09.954978 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 599/1216] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:41:09 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:41:10.978253 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8ab29625-d200-4075-8ba1-9d50c9c329c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:10.978838 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8ab29625-d200-4075-8ba1-9d50c9c329c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:10.985376 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ab29625-d200-4075-8ba1-9d50c9c329c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:10.985853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ab29625-d200-4075-8ba1-9d50c9c329c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:10.986305 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ab29625-d200-4075-8ba1-9d50c9c329c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:10.986992 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ab29625-d200-4075-8ba1-9d50c9c329c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:10.987437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ab29625-d200-4075-8ba1-9d50c9c329c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:10.987854 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ab29625-d200-4075-8ba1-9d50c9c329c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:11.017467 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-cd7f48e5-ed26-4c08-a097-2bfedb1616bb req-ea44ab9d-a86c-4221-881e-2d92b3f7158b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c3349f-3561-4764-94db-a6a5189f5ff7", "name": "network-vif-plugged", "status": "completed", "tag": "c52e1955-c066-4d21-adb0-3e0d49febdb3"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:41:11.028490 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-cd7f48e5-ed26-4c08-a097-2bfedb1616bb req-ea44ab9d-a86c-4221-881e-2d92b3f7158b service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:11.028966 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-cd7f48e5-ed26-4c08-a097-2bfedb1616bb req-ea44ab9d-a86c-4221-881e-2d92b3f7158b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:11.029494 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-cd7f48e5-ed26-4c08-a097-2bfedb1616bb req-ea44ab9d-a86c-4221-881e-2d92b3f7158b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:11.041541 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-cd7f48e5-ed26-4c08-a097-2bfedb1616bb req-ea44ab9d-a86c-4221-881e-2d92b3f7158b service nova] Creating event network-vif-plugged:c52e1955-c066-4d21-adb0-3e0d49febdb3 for instance 32c3349f-3561-4764-94db-a6a5189f5ff7 on hv-cinder-85427 Aug 24 11:41:11.046924 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-cd7f48e5-ed26-4c08-a097-2bfedb1616bb req-ea44ab9d-a86c-4221-881e-2d92b3f7158b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033116 Aug 24 11:41:11.047787 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 600/1217] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:41:11.121423 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8ab29625-d200-4075-8ba1-9d50c9c329c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:11.130162 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8ab29625-d200-4075-8ba1-9d50c9c329c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:11.131722 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8ab29625-d200-4075-8ba1-9d50c9c329c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:11.132908 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8ab29625-d200-4075-8ba1-9d50c9c329c6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.159175 Aug 24 11:41:11.133480 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 618/1218] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:41:10 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:41:12.157435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-bd6bae41-6852-42b6-9cb8-34514ddf98e6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:12.158084 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-bd6bae41-6852-42b6-9cb8-34514ddf98e6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:12.164198 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bd6bae41-6852-42b6-9cb8-34514ddf98e6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:12.164669 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bd6bae41-6852-42b6-9cb8-34514ddf98e6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:12.165098 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bd6bae41-6852-42b6-9cb8-34514ddf98e6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:12.165774 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bd6bae41-6852-42b6-9cb8-34514ddf98e6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:12.166333 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bd6bae41-6852-42b6-9cb8-34514ddf98e6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:12.166747 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bd6bae41-6852-42b6-9cb8-34514ddf98e6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:12.295726 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-bd6bae41-6852-42b6-9cb8-34514ddf98e6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:12.304704 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-bd6bae41-6852-42b6-9cb8-34514ddf98e6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:12.306223 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-bd6bae41-6852-42b6-9cb8-34514ddf98e6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:12.307577 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-bd6bae41-6852-42b6-9cb8-34514ddf98e6 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.155023 Aug 24 11:41:12.308133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 601/1219] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:41:12 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:41:13.329935 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4929f06e-c02d-4b6a-8c71-c5c563513129 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:13.330559 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4929f06e-c02d-4b6a-8c71-c5c563513129 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:13.337837 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4929f06e-c02d-4b6a-8c71-c5c563513129 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:13.338245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4929f06e-c02d-4b6a-8c71-c5c563513129 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:13.338682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4929f06e-c02d-4b6a-8c71-c5c563513129 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:13.339377 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4929f06e-c02d-4b6a-8c71-c5c563513129 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:13.340025 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4929f06e-c02d-4b6a-8c71-c5c563513129 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:13.340454 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4929f06e-c02d-4b6a-8c71-c5c563513129 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:13.477490 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4929f06e-c02d-4b6a-8c71-c5c563513129 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:13.485836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4929f06e-c02d-4b6a-8c71-c5c563513129 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:13.494665 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4929f06e-c02d-4b6a-8c71-c5c563513129 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:13.494665 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4929f06e-c02d-4b6a-8c71-c5c563513129 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.162567 Aug 24 11:41:13.494665 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 619/1220] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:41:13 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:41:14.511567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e8f1256f-a996-45d6-a78b-fe377c3ae0da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:14.512280 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e8f1256f-a996-45d6-a78b-fe377c3ae0da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:14.518956 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e8f1256f-a996-45d6-a78b-fe377c3ae0da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:14.519556 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e8f1256f-a996-45d6-a78b-fe377c3ae0da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:14.520001 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e8f1256f-a996-45d6-a78b-fe377c3ae0da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:14.520699 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e8f1256f-a996-45d6-a78b-fe377c3ae0da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:14.521152 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e8f1256f-a996-45d6-a78b-fe377c3ae0da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:14.521582 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e8f1256f-a996-45d6-a78b-fe377c3ae0da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:14.663030 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e8f1256f-a996-45d6-a78b-fe377c3ae0da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:14.671277 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e8f1256f-a996-45d6-a78b-fe377c3ae0da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:14.673637 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-e8f1256f-a996-45d6-a78b-fe377c3ae0da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:14.674049 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e8f1256f-a996-45d6-a78b-fe377c3ae0da tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1731 microversion: 2.20 time: 0.166512 Aug 24 11:41:14.674610 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 602/1221] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:41:14 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:41:15.696718 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3800c5e7-1a76-4292-9772-db52825f2d8e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:41:15.697319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3800c5e7-1a76-4292-9772-db52825f2d8e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:41:15.703805 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3800c5e7-1a76-4292-9772-db52825f2d8e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:15.704290 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3800c5e7-1a76-4292-9772-db52825f2d8e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:15.704719 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3800c5e7-1a76-4292-9772-db52825f2d8e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:15.705398 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3800c5e7-1a76-4292-9772-db52825f2d8e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:41:15.705841 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3800c5e7-1a76-4292-9772-db52825f2d8e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:41:15.706288 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3800c5e7-1a76-4292-9772-db52825f2d8e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:41:15.835370 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3800c5e7-1a76-4292-9772-db52825f2d8e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:15.843631 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3800c5e7-1a76-4292-9772-db52825f2d8e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:15.845156 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3800c5e7-1a76-4292-9772-db52825f2d8e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:41:15.846331 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3800c5e7-1a76-4292-9772-db52825f2d8e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1718 microversion: 2.20 time: 0.153620 Aug 24 11:41:15.846877 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 620/1222] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:41:15 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:42:11.296312 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e905e3fb-6fa6-45a9-9192-c2030739b4b4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:11.298547 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-e905e3fb-6fa6-45a9-9192-c2030739b4b4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:11.300877 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=21 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:11.301549 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=63 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:11.306346 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e905e3fb-6fa6-45a9-9192-c2030739b4b4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:11.306834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e905e3fb-6fa6-45a9-9192-c2030739b4b4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:11.307490 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e905e3fb-6fa6-45a9-9192-c2030739b4b4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:11.307951 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e905e3fb-6fa6-45a9-9192-c2030739b4b4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:11.308400 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e905e3fb-6fa6-45a9-9192-c2030739b4b4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:11.308820 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-e905e3fb-6fa6-45a9-9192-c2030739b4b4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:11.347017 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e905e3fb-6fa6-45a9-9192-c2030739b4b4 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054656 Aug 24 11:42:11.349288 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 603/1223] 10.222.0.83 () {60 vars in 1343 bytes} [Wed Aug 24 11:42:11 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:42:11.410840 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-023927c3-13d5-45af-ac56-e82096b24d96 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:11.411443 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-023927c3-13d5-45af-ac56-e82096b24d96 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:11.413334 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=15 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:11.414034 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=54 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:42:11.418880 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-023927c3-13d5-45af-ac56-e82096b24d96 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:11.430303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-023927c3-13d5-45af-ac56-e82096b24d96 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:11.430303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-023927c3-13d5-45af-ac56-e82096b24d96 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:11.430303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-023927c3-13d5-45af-ac56-e82096b24d96 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:11.430303 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-023927c3-13d5-45af-ac56-e82096b24d96 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:11.430917 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-023927c3-13d5-45af-ac56-e82096b24d96 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:11.450458 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-023927c3-13d5-45af-ac56-e82096b24d96 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:42:11.808541 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-023927c3-13d5-45af-ac56-e82096b24d96 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "DELETE /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 204 len: 0 microversion: 2.20 time: 0.401014 Aug 24 11:42:11.809135 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 621/1224] 10.222.0.83 () {60 vars in 1280 bytes} [Wed Aug 24 11:42:11 2022] DELETE /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 11:42:11.817246 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-17cb5339-ef2f-4536-b83b-2a02ae786280 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:11.825436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-17cb5339-ef2f-4536-b83b-2a02ae786280 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:11.825436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-17cb5339-ef2f-4536-b83b-2a02ae786280 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:11.825436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-17cb5339-ef2f-4536-b83b-2a02ae786280 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:11.825436 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-17cb5339-ef2f-4536-b83b-2a02ae786280 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:11.825954 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-17cb5339-ef2f-4536-b83b-2a02ae786280 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:11.826164 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-17cb5339-ef2f-4536-b83b-2a02ae786280 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:11.826579 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-17cb5339-ef2f-4536-b83b-2a02ae786280 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:11.956248 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-17cb5339-ef2f-4536-b83b-2a02ae786280 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:11.964506 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-17cb5339-ef2f-4536-b83b-2a02ae786280 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:11.966047 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-17cb5339-ef2f-4536-b83b-2a02ae786280 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:11.967246 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-17cb5339-ef2f-4536-b83b-2a02ae786280 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.153873 Aug 24 11:42:11.967817 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 604/1225] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:42:11 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:42:12.995239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8cf05740-f051-4c30-abb3-0eb9089372fc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:12.995871 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8cf05740-f051-4c30-abb3-0eb9089372fc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:13.002748 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cf05740-f051-4c30-abb3-0eb9089372fc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:13.003231 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cf05740-f051-4c30-abb3-0eb9089372fc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:13.003668 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cf05740-f051-4c30-abb3-0eb9089372fc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:13.004365 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cf05740-f051-4c30-abb3-0eb9089372fc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:13.004820 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cf05740-f051-4c30-abb3-0eb9089372fc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:13.005249 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cf05740-f051-4c30-abb3-0eb9089372fc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:13.136340 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8cf05740-f051-4c30-abb3-0eb9089372fc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:13.144644 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8cf05740-f051-4c30-abb3-0eb9089372fc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:13.146194 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8cf05740-f051-4c30-abb3-0eb9089372fc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:13.147348 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8cf05740-f051-4c30-abb3-0eb9089372fc tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.157105 Aug 24 11:42:13.147893 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 622/1226] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:42:12 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:42:14.171527 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-7dd8f078-3d48-4a18-b30e-6de31d15e4ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:14.172093 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-7dd8f078-3d48-4a18-b30e-6de31d15e4ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:14.178758 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7dd8f078-3d48-4a18-b30e-6de31d15e4ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:14.179248 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7dd8f078-3d48-4a18-b30e-6de31d15e4ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:14.179686 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7dd8f078-3d48-4a18-b30e-6de31d15e4ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:14.180390 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7dd8f078-3d48-4a18-b30e-6de31d15e4ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:14.180853 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7dd8f078-3d48-4a18-b30e-6de31d15e4ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:14.181275 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-7dd8f078-3d48-4a18-b30e-6de31d15e4ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:14.327512 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7dd8f078-3d48-4a18-b30e-6de31d15e4ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:14.336295 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7dd8f078-3d48-4a18-b30e-6de31d15e4ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:14.337834 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-7dd8f078-3d48-4a18-b30e-6de31d15e4ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:14.339055 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-7dd8f078-3d48-4a18-b30e-6de31d15e4ea tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1724 microversion: 2.20 time: 0.171712 Aug 24 11:42:14.339626 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 605/1227] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:42:14 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:42:15.102827 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-63d2717b-0c70-4542-a0cc-387608cbe9ef req-c597bf79-c647-4211-9c57-f124d43c0a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c3349f-3561-4764-94db-a6a5189f5ff7", "name": "network-vif-deleted", "tag": "c52e1955-c066-4d21-adb0-3e0d49febdb3"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:42:15.114387 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-63d2717b-0c70-4542-a0cc-387608cbe9ef req-c597bf79-c647-4211-9c57-f124d43c0a3b service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:15.115029 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-63d2717b-0c70-4542-a0cc-387608cbe9ef req-c597bf79-c647-4211-9c57-f124d43c0a3b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:15.115474 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-63d2717b-0c70-4542-a0cc-387608cbe9ef req-c597bf79-c647-4211-9c57-f124d43c0a3b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:15.129604 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-63d2717b-0c70-4542-a0cc-387608cbe9ef req-c597bf79-c647-4211-9c57-f124d43c0a3b service nova] Creating event network-vif-deleted:c52e1955-c066-4d21-adb0-3e0d49febdb3 for instance 32c3349f-3561-4764-94db-a6a5189f5ff7 on hv-cinder-85427 Aug 24 11:42:15.135055 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-63d2717b-0c70-4542-a0cc-387608cbe9ef req-c597bf79-c647-4211-9c57-f124d43c0a3b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035913 Aug 24 11:42:15.139128 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 623/1228] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:42:15.362845 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-c0797668-41d3-4882-ad38-6fc8eac35fd1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:15.363438 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-c0797668-41d3-4882-ad38-6fc8eac35fd1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:15.370408 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c0797668-41d3-4882-ad38-6fc8eac35fd1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:15.371416 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c0797668-41d3-4882-ad38-6fc8eac35fd1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:15.371854 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c0797668-41d3-4882-ad38-6fc8eac35fd1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:15.372799 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c0797668-41d3-4882-ad38-6fc8eac35fd1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:15.373012 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c0797668-41d3-4882-ad38-6fc8eac35fd1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:15.373437 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-c0797668-41d3-4882-ad38-6fc8eac35fd1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:15.450395 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c0797668-41d3-4882-ad38-6fc8eac35fd1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:15.459592 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c0797668-41d3-4882-ad38-6fc8eac35fd1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:15.461112 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-c0797668-41d3-4882-ad38-6fc8eac35fd1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dfbe3078d714129b5a6e6e45dbc0b25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6ccf52d6394c01859a5ccf0774f2d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:42:15.462308 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-c0797668-41d3-4882-ad38-6fc8eac35fd1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 200 len: 1367 microversion: 2.20 time: 0.103463 Aug 24 11:42:15.462873 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 606/1229] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:42:15 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 1367 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 11:42:16.486536 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d08e842d-bed6-40e4-a809-2fb2e8ad2e18 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:16.487356 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d08e842d-bed6-40e4-a809-2fb2e8ad2e18 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:16.493565 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d08e842d-bed6-40e4-a809-2fb2e8ad2e18 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:16.494086 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d08e842d-bed6-40e4-a809-2fb2e8ad2e18 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:16.494523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d08e842d-bed6-40e4-a809-2fb2e8ad2e18 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:16.495210 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d08e842d-bed6-40e4-a809-2fb2e8ad2e18 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:16.495661 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d08e842d-bed6-40e4-a809-2fb2e8ad2e18 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:16.496084 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d08e842d-bed6-40e4-a809-2fb2e8ad2e18 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:16.509746 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-d08e842d-bed6-40e4-a809-2fb2e8ad2e18 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] HTTP exception thrown: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d08e842d-bed6-40e4-a809-2fb2e8ad2e18 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Request method failure captured: Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 HTTP/1.1 Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgyjhtQXYgncW68BnusXNWePOcVFX2TmeKpKgiit_IKWShPIwHG5aiiUIBmT721QiJ2tB1bn0PiemxeTgvbXO1TlZv10swD4aK_kaMKgGGIQuGaGjuJFjj0Y9OAVgu8dWq_pmonHIMv_zrcJrtcYIKLWAhOxUav9ZRS3pDY-m2A3RO0 Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: de6ccf52d6394c01859a5ccf0774f2d8 Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:42:16.512080 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:42:16.514004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_de6ccf52d6394c01859a5ccf0774f2d8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:42:16.514004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:16.514004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: de6ccf52d6394c01859a5ccf0774f2d8 Aug 24 11:42:16.514004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:16.514004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeShelveTestJSON-323412020-project Aug 24 11:42:16.514004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:42:16.514004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:42:16.514004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 4dfbe3078d714129b5a6e6e45dbc0b25 Aug 24 11:42:16.514004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeShelveTestJSON-323412020-project Aug 24 11:42:16.514004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:42:16.514004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:16.514004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '32c3349f-3561-4764-94db-a6a5189f5ff7'} Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:42:16.515163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:16.516839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:16.518312 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d08e842d-bed6-40e4-a809-2fb2e8ad2e18 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Returning 404 to user: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:42:16.518312 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d08e842d-bed6-40e4-a809-2fb2e8ad2e18 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 404 len: 111 microversion: 2.20 time: 0.031756 Aug 24 11:42:16.518312 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 624/1230] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:42:16 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 11:42:16.522788 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e0f21084-87a0-48e1-9f24-142d7140aad1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '.version_select at 0x7f723d1bc280>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:16.628618 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e0f21084-87a0-48e1-9f24-142d7140aad1 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082554467" status: 204 len: 0 microversion: 2.20 time: 0.109579 Aug 24 11:42:16.628618 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 607/1231] 10.222.0.83 () {60 vars in 1262 bytes} [Wed Aug 24 11:42:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082554467 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 11:42:18.716087 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f862d7ca-768f-4b9f-b2d2-1ccc56df8867 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:18.716630 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f862d7ca-768f-4b9f-b2d2-1ccc56df8867 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:18.722972 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f862d7ca-768f-4b9f-b2d2-1ccc56df8867 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:18.723447 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f862d7ca-768f-4b9f-b2d2-1ccc56df8867 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:18.723870 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f862d7ca-768f-4b9f-b2d2-1ccc56df8867 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:18.724581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f862d7ca-768f-4b9f-b2d2-1ccc56df8867 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:18.725038 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f862d7ca-768f-4b9f-b2d2-1ccc56df8867 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:18.725450 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f862d7ca-768f-4b9f-b2d2-1ccc56df8867 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:18.739172 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-f862d7ca-768f-4b9f-b2d2-1ccc56df8867 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] HTTP exception thrown: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f862d7ca-768f-4b9f-b2d2-1ccc56df8867 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Request method failure captured: Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 HTTP/1.1 Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgyjhtQXYgncW68BnusXNWePOcVFX2TmeKpKgiit_IKWShPIwHG5aiiUIBmT721QiJ2tB1bn0PiemxeTgvbXO1TlZv10swD4aK_kaMKgGGIQuGaGjuJFjj0Y9OAVgu8dWq_pmonHIMv_zrcJrtcYIKLWAhOxUav9ZRS3pDY-m2A3RO0 Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: de6ccf52d6394c01859a5ccf0774f2d8 Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:42:18.740717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:42:18.742487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_de6ccf52d6394c01859a5ccf0774f2d8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:42:18.742487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:18.742487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: de6ccf52d6394c01859a5ccf0774f2d8 Aug 24 11:42:18.742487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:18.742487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeShelveTestJSON-323412020-project Aug 24 11:42:18.742487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:42:18.742487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:42:18.742487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 4dfbe3078d714129b5a6e6e45dbc0b25 Aug 24 11:42:18.742487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeShelveTestJSON-323412020-project Aug 24 11:42:18.742487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:42:18.742487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:18.742487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '32c3349f-3561-4764-94db-a6a5189f5ff7'} Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:42:18.743464 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:18.745171 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:18.747470 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f862d7ca-768f-4b9f-b2d2-1ccc56df8867 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Returning 404 to user: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:42:18.747470 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f862d7ca-768f-4b9f-b2d2-1ccc56df8867 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "DELETE /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 404 len: 111 microversion: 2.20 time: 0.030292 Aug 24 11:42:18.747470 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 625/1232] 10.222.0.83 () {60 vars in 1280 bytes} [Wed Aug 24 11:42:18 2022] DELETE /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:42:18.752131 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-db6257e9-41e3-4158-b17f-804f649b1f2e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:18.752748 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-db6257e9-41e3-4158-b17f-804f649b1f2e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 32c3349f-3561-4764-94db-a6a5189f5ff7] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:18.759485 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-db6257e9-41e3-4158-b17f-804f649b1f2e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:18.759972 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-db6257e9-41e3-4158-b17f-804f649b1f2e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:18.760411 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-db6257e9-41e3-4158-b17f-804f649b1f2e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:18.761100 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-db6257e9-41e3-4158-b17f-804f649b1f2e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:18.761557 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-db6257e9-41e3-4158-b17f-804f649b1f2e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:18.762013 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-db6257e9-41e3-4158-b17f-804f649b1f2e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:18.775040 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-db6257e9-41e3-4158-b17f-804f649b1f2e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] HTTP exception thrown: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-db6257e9-41e3-4158-b17f-804f649b1f2e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Request method failure captured: Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 HTTP/1.1 Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgyjhtQXYgncW68BnusXNWePOcVFX2TmeKpKgiit_IKWShPIwHG5aiiUIBmT721QiJ2tB1bn0PiemxeTgvbXO1TlZv10swD4aK_kaMKgGGIQuGaGjuJFjj0Y9OAVgu8dWq_pmonHIMv_zrcJrtcYIKLWAhOxUav9ZRS3pDY-m2A3RO0 Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: de6ccf52d6394c01859a5ccf0774f2d8 Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:42:18.776703 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:42:18.778654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_de6ccf52d6394c01859a5ccf0774f2d8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:42:18.778654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:18.778654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: de6ccf52d6394c01859a5ccf0774f2d8 Aug 24 11:42:18.778654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:18.778654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-AttachVolumeShelveTestJSON-323412020-project Aug 24 11:42:18.778654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:42:18.778654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:42:18.778654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 4dfbe3078d714129b5a6e6e45dbc0b25 Aug 24 11:42:18.778654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-AttachVolumeShelveTestJSON-323412020-project Aug 24 11:42:18.778654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:42:18.778654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:18.778654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': '32c3349f-3561-4764-94db-a6a5189f5ff7'} Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:42:18.779584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. Aug 24 11:42:18.780910 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:42:18.782718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-db6257e9-41e3-4158-b17f-804f649b1f2e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Returning 404 to user: Instance 32c3349f-3561-4764-94db-a6a5189f5ff7 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:42:18.782718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-db6257e9-41e3-4158-b17f-804f649b1f2e tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7" status: 404 len: 111 microversion: 2.20 time: 0.030732 Aug 24 11:42:18.782718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 608/1233] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:42:18 2022] GET /compute/v2.1/servers/32c3349f-3561-4764-94db-a6a5189f5ff7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:42:20.154741 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-daa9c4b5-379b-4e46-aee6-c889dd979a41 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:20.155340 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-daa9c4b5-379b-4e46-aee6-c889dd979a41 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:20.162433 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-daa9c4b5-379b-4e46-aee6-c889dd979a41 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:20.162924 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-daa9c4b5-379b-4e46-aee6-c889dd979a41 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:20.163358 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-daa9c4b5-379b-4e46-aee6-c889dd979a41 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:20.164047 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-daa9c4b5-379b-4e46-aee6-c889dd979a41 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:20.164495 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-daa9c4b5-379b-4e46-aee6-c889dd979a41 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:20.164912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-daa9c4b5-379b-4e46-aee6-c889dd979a41 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:20.178418 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-daa9c4b5-379b-4e46-aee6-c889dd979a41 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] HTTP exception thrown: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-daa9c4b5-379b-4e46-aee6-c889dd979a41 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Request method failure captured: Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 HTTP/1.1 Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBgyjhtQXYgncW68BnusXNWePOcVFX2TmeKpKgiit_IKWShPIwHG5aiiUIBmT721QiJ2tB1bn0PiemxeTgvbXO1TlZv10swD4aK_kaMKgGGIQuGaGjuJFjj0Y9OAVgu8dWq_pmonHIMv_zrcJrtcYIKLWAhOxUav9ZRS3pDY-m2A3RO0 Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: de6ccf52d6394c01859a5ccf0774f2d8 Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:42:20.180552 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:42:20.185852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_de6ccf52d6394c01859a5ccf0774f2d8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:42:20.185852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:20.185852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: de6ccf52d6394c01859a5ccf0774f2d8 Aug 24 11:42:20.185852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:20.185852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeShelveTestJSON-323412020-project Aug 24 11:42:20.185852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:42:20.185852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:42:20.185852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 4dfbe3078d714129b5a6e6e45dbc0b25 Aug 24 11:42:20.185852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeShelveTestJSON-323412020-project Aug 24 11:42:20.185852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:42:20.185852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:42:20.185852 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '17c6a206-49d7-44b6-a24f-f5961f099597'} Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:42:20.186910 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:42:20.188514 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:42:20.190093 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-daa9c4b5-379b-4e46-aee6-c889dd979a41 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Returning 404 to user: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:42:20.190093 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-daa9c4b5-379b-4e46-aee6-c889dd979a41 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "DELETE /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 404 len: 111 microversion: 2.20 time: 0.032056 Aug 24 11:42:20.190093 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 626/1234] 10.222.0.83 () {60 vars in 1280 bytes} [Wed Aug 24 11:42:20 2022] DELETE /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:42:20.191147 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-671cb4b1-f6ae-4453-b622-b47f72595533 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:42:20.191764 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-671cb4b1-f6ae-4453-b622-b47f72595533 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] [instance: 17c6a206-49d7-44b6-a24f-f5961f099597] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:42:20.198266 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-671cb4b1-f6ae-4453-b622-b47f72595533 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:20.198750 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-671cb4b1-f6ae-4453-b622-b47f72595533 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:20.199185 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-671cb4b1-f6ae-4453-b622-b47f72595533 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:20.199875 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-671cb4b1-f6ae-4453-b622-b47f72595533 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:42:20.200359 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-671cb4b1-f6ae-4453-b622-b47f72595533 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:42:20.201329 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-671cb4b1-f6ae-4453-b622-b47f72595533 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:42:20.215012 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-671cb4b1-f6ae-4453-b622-b47f72595533 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] HTTP exception thrown: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-671cb4b1-f6ae-4453-b622-b47f72595533 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Request method failure captured: Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 HTTP/1.1 Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBgyjhtQXYgncW68BnusXNWePOcVFX2TmeKpKgiit_IKWShPIwHG5aiiUIBmT721QiJ2tB1bn0PiemxeTgvbXO1TlZv10swD4aK_kaMKgGGIQuGaGjuJFjj0Y9OAVgu8dWq_pmonHIMv_zrcJrtcYIKLWAhOxUav9ZRS3pDY-m2A3RO0 Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: de6ccf52d6394c01859a5ccf0774f2d8 Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:42:20.217160 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:42:20.219126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_de6ccf52d6394c01859a5ccf0774f2d8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/de6ccf52d6394c01859a5ccf0774f2d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:42:20.219126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:20.219126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: de6ccf52d6394c01859a5ccf0774f2d8 Aug 24 11:42:20.219126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-323412020 Aug 24 11:42:20.219126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-AttachVolumeShelveTestJSON-323412020-project Aug 24 11:42:20.219126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:42:20.219126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:42:20.219126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 4dfbe3078d714129b5a6e6e45dbc0b25 Aug 24 11:42:20.219126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-AttachVolumeShelveTestJSON-323412020-project Aug 24 11:42:20.219126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:42:20.219126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:42:20.219126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': '17c6a206-49d7-44b6-a24f-f5961f099597'} Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:42:20.220236 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. Aug 24 11:42:20.221830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:42:20.223449 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-671cb4b1-f6ae-4453-b622-b47f72595533 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] Returning 404 to user: Instance 17c6a206-49d7-44b6-a24f-f5961f099597 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:42:20.223449 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-671cb4b1-f6ae-4453-b622-b47f72595533 tempest-AttachVolumeShelveTestJSON-323412020 tempest-AttachVolumeShelveTestJSON-323412020-project] 10.222.0.83 "GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597" status: 404 len: 111 microversion: 2.20 time: 0.031479 Aug 24 11:42:20.223449 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 609/1235] 10.222.0.83 () {60 vars in 1277 bytes} [Wed Aug 24 11:42:20 2022] GET /compute/v2.1/servers/17c6a206-49d7-44b6-a24f-f5961f099597 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 11:43:11.515297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:43:11.515921 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:43:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:43:15.007468 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:43:15.008179 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:43:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:43:19.371387 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:43:19.371991 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Wed Aug 24 11:43:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:44:02.467382 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:02.468612 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:02.670516 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c2730f8c-8fa4-484c-b30f-389f67b30a32 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Action: 'create', calling method: .version_select at 0x7f723d7f2040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1093131630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIOF+z69eAwlD9bKxivTl9G+OMJG/CUwZWVRKHE6Hgg9wxHY3iyfyef4yBlNW415td2mvdOe/Zdzdl7CupyS9uOXddufmI1XCZrYIz4Z90py9KhV2HkLWGPY/UDwaX0Jg=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:44:02.687486 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-c2730f8c-8fa4-484c-b30f-389f67b30a32 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Getting quotas for project 548b5e4f59b24f0a9b88bf125c8a19a8. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:44:02.691265 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-c2730f8c-8fa4-484c-b30f-389f67b30a32 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Getting quotas for user 4edfa99b10014e8289697a255d8b90cf and project 548b5e4f59b24f0a9b88bf125c8a19a8. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:44:02.796839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c2730f8c-8fa4-484c-b30f-389f67b30a32 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.331295 Aug 24 11:44:02.797615 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 627/1236] 10.222.0.83 () {60 vars in 1159 bytes} [Wed Aug 24 11:44:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:44:27.358954 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:27.359935 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=28 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:27.363877 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-853965903", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1093131630", "security_groups": [{"name": "tempest-secgroup-smoke-1686689868"}], "block_device_mapping_v2": [{"uuid": "42544db9-f20e-4fe8-86e7-ddbe3d486cf2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ef9e4d00-e993-40b5-ae2f-15a637a6c58e"}]}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:44:27.476640 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] validate_networks() for [('ef9e4d00-e993-40b5-ae2f-15a637a6c58e', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:44:27.928948 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:44:27.929950 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:44:27.930455 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:44:27.930863 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:44:27.931269 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:44:27.939925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:27.940402 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:27.940830 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:27.941551 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:27.942126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:27.942547 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:27.959497 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Getting quotas for project 548b5e4f59b24f0a9b88bf125c8a19a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:44:27.963916 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Getting quotas for user 4edfa99b10014e8289697a255d8b90cf and project 548b5e4f59b24f0a9b88bf125c8a19a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:44:28.020525 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:44:28.022688 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='42544db9-f20e-4fe8-86e7-ddbe3d486cf2',volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:44:28.375103 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8748060e-2a66-46f0-84fb-b165db1c1f69 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.017913 Aug 24 11:44:28.375738 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 610/1237] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:44:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 11:44:28.386723 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d0ef4e73-b3bd-457f-b306-0997b8ca9e5b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:28.387381 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d0ef4e73-b3bd-457f-b306-0997b8ca9e5b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:28.390123 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=4 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:28.390755 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:28.446746 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d0ef4e73-b3bd-457f-b306-0997b8ca9e5b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:28.454027 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d0ef4e73-b3bd-457f-b306-0997b8ca9e5b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1094 microversion: 2.1 time: 0.071260 Aug 24 11:44:28.454606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 628/1238] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:28 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:29.474854 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-62571206-3e3c-4bdd-a3e8-f9ae9abf93e8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:29.475410 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-62571206-3e3c-4bdd-a3e8-f9ae9abf93e8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:29.531590 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-62571206-3e3c-4bdd-a3e8-f9ae9abf93e8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:29.538690 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-62571206-3e3c-4bdd-a3e8-f9ae9abf93e8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1094 microversion: 2.1 time: 0.068415 Aug 24 11:44:29.539254 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 611/1239] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:29 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:30.559741 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-37b5e0bf-776c-4cd5-8aad-fa089af78e09 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:30.560360 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-37b5e0bf-776c-4cd5-8aad-fa089af78e09 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:30.614237 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-37b5e0bf-776c-4cd5-8aad-fa089af78e09 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:30.622841 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-37b5e0bf-776c-4cd5-8aad-fa089af78e09 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1094 microversion: 2.1 time: 0.067050 Aug 24 11:44:30.623497 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 629/1240] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:30 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:31.644153 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b11b72b1-c4d6-4011-9368-73d445362416 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:31.644705 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b11b72b1-c4d6-4011-9368-73d445362416 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:31.701488 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b11b72b1-c4d6-4011-9368-73d445362416 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:31.708618 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b11b72b1-c4d6-4011-9368-73d445362416 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1094 microversion: 2.1 time: 0.068477 Aug 24 11:44:31.709180 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 612/1241] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:31 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:32.729673 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4db8f5ae-5600-460b-9e99-116835ad1d14 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:32.730325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4db8f5ae-5600-460b-9e99-116835ad1d14 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:32.736745 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4db8f5ae-5600-460b-9e99-116835ad1d14 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:32.737223 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4db8f5ae-5600-460b-9e99-116835ad1d14 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:32.737655 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4db8f5ae-5600-460b-9e99-116835ad1d14 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:32.738372 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4db8f5ae-5600-460b-9e99-116835ad1d14 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:32.738819 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4db8f5ae-5600-460b-9e99-116835ad1d14 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:32.739234 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4db8f5ae-5600-460b-9e99-116835ad1d14 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:32.802261 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4db8f5ae-5600-460b-9e99-116835ad1d14 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:32.809915 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4db8f5ae-5600-460b-9e99-116835ad1d14 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1144 microversion: 2.1 time: 0.085168 Aug 24 11:44:32.810481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 630/1242] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:32 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:33.829807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-931a2d7c-35fa-4707-94fd-2228c55ff74a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:33.830459 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-931a2d7c-35fa-4707-94fd-2228c55ff74a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:33.837493 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-931a2d7c-35fa-4707-94fd-2228c55ff74a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:33.838003 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-931a2d7c-35fa-4707-94fd-2228c55ff74a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:33.838433 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-931a2d7c-35fa-4707-94fd-2228c55ff74a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:33.839110 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-931a2d7c-35fa-4707-94fd-2228c55ff74a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:33.839553 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-931a2d7c-35fa-4707-94fd-2228c55ff74a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:33.839969 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-931a2d7c-35fa-4707-94fd-2228c55ff74a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:33.903314 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-931a2d7c-35fa-4707-94fd-2228c55ff74a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:33.912190 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-931a2d7c-35fa-4707-94fd-2228c55ff74a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1144 microversion: 2.1 time: 0.085675 Aug 24 11:44:33.912190 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 613/1243] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:33 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:34.931927 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9f36e727-4bb8-487d-bf2c-6d9a833d6e70 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:34.932553 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9f36e727-4bb8-487d-bf2c-6d9a833d6e70 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:34.939433 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f36e727-4bb8-487d-bf2c-6d9a833d6e70 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:34.941669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f36e727-4bb8-487d-bf2c-6d9a833d6e70 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:34.941669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f36e727-4bb8-487d-bf2c-6d9a833d6e70 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:34.941669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f36e727-4bb8-487d-bf2c-6d9a833d6e70 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:34.941669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f36e727-4bb8-487d-bf2c-6d9a833d6e70 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:34.942145 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f36e727-4bb8-487d-bf2c-6d9a833d6e70 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:35.023221 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9f36e727-4bb8-487d-bf2c-6d9a833d6e70 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:35.031331 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9f36e727-4bb8-487d-bf2c-6d9a833d6e70 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1200 microversion: 2.1 time: 0.103395 Aug 24 11:44:35.032116 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 631/1244] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:34 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1200 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:36.053745 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2d54080e-3b55-465b-8621-ad0a5593dbde tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:36.054891 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-2d54080e-3b55-465b-8621-ad0a5593dbde tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:36.061305 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2d54080e-3b55-465b-8621-ad0a5593dbde tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:36.063369 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2d54080e-3b55-465b-8621-ad0a5593dbde tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:36.063369 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2d54080e-3b55-465b-8621-ad0a5593dbde tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:36.063369 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2d54080e-3b55-465b-8621-ad0a5593dbde tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:36.063917 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2d54080e-3b55-465b-8621-ad0a5593dbde tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:36.064031 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2d54080e-3b55-465b-8621-ad0a5593dbde tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:36.202570 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-2d54080e-3b55-465b-8621-ad0a5593dbde tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:36.211033 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-2d54080e-3b55-465b-8621-ad0a5593dbde tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1278 microversion: 2.1 time: 0.162019 Aug 24 11:44:36.211610 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 614/1245] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:36 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:36.590378 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-9a1749a3-310f-4a76-aabb-b80acd8b423b req-ff0daf2e-db85-4a7d-993b-0ae5da879dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b77d1842-757c-4c5e-9187-54b891e4feee", "tag": "898b5481-c218-49ee-836f-a580e8508ed4"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:44:36.600163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9a1749a3-310f-4a76-aabb-b80acd8b423b req-ff0daf2e-db85-4a7d-993b-0ae5da879dcc service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:36.600646 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9a1749a3-310f-4a76-aabb-b80acd8b423b req-ff0daf2e-db85-4a7d-993b-0ae5da879dcc service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:36.601657 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9a1749a3-310f-4a76-aabb-b80acd8b423b req-ff0daf2e-db85-4a7d-993b-0ae5da879dcc service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:36.613636 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-9a1749a3-310f-4a76-aabb-b80acd8b423b req-ff0daf2e-db85-4a7d-993b-0ae5da879dcc service nova] Creating event network-changed:898b5481-c218-49ee-836f-a580e8508ed4 for instance b77d1842-757c-4c5e-9187-54b891e4feee on hv-cinder-85427 Aug 24 11:44:36.619020 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-9a1749a3-310f-4a76-aabb-b80acd8b423b req-ff0daf2e-db85-4a7d-993b-0ae5da879dcc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096617 Aug 24 11:44:36.619615 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 632/1246] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:44:37.237421 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9a68ed0b-109f-4054-9c84-b3696652b506 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:37.238126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9a68ed0b-109f-4054-9c84-b3696652b506 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:37.245125 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9a68ed0b-109f-4054-9c84-b3696652b506 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:37.245611 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9a68ed0b-109f-4054-9c84-b3696652b506 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:37.246063 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9a68ed0b-109f-4054-9c84-b3696652b506 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:37.246749 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9a68ed0b-109f-4054-9c84-b3696652b506 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:37.247453 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9a68ed0b-109f-4054-9c84-b3696652b506 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:37.247871 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9a68ed0b-109f-4054-9c84-b3696652b506 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:37.381555 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9a68ed0b-109f-4054-9c84-b3696652b506 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:37.389505 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9a68ed0b-109f-4054-9c84-b3696652b506 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1266 microversion: 2.1 time: 0.155903 Aug 24 11:44:37.390116 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 615/1247] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:37 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:38.411899 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2650cc82-c95f-4421-8697-b3d2a84bb6cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:38.412593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2650cc82-c95f-4421-8697-b3d2a84bb6cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:38.418797 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2650cc82-c95f-4421-8697-b3d2a84bb6cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:38.419284 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2650cc82-c95f-4421-8697-b3d2a84bb6cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:38.419724 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2650cc82-c95f-4421-8697-b3d2a84bb6cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:38.420416 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2650cc82-c95f-4421-8697-b3d2a84bb6cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:38.420868 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2650cc82-c95f-4421-8697-b3d2a84bb6cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:38.421291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2650cc82-c95f-4421-8697-b3d2a84bb6cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:38.562270 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2650cc82-c95f-4421-8697-b3d2a84bb6cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:38.570540 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2650cc82-c95f-4421-8697-b3d2a84bb6cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1266 microversion: 2.1 time: 0.163467 Aug 24 11:44:38.571094 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 633/1248] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:38 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:39.592151 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-834c6102-209d-4bcc-a0ed-b549058b7e1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:39.592684 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-834c6102-209d-4bcc-a0ed-b549058b7e1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:39.594547 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:39.599568 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-834c6102-209d-4bcc-a0ed-b549058b7e1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:39.600054 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-834c6102-209d-4bcc-a0ed-b549058b7e1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:39.600491 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-834c6102-209d-4bcc-a0ed-b549058b7e1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:39.601186 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-834c6102-209d-4bcc-a0ed-b549058b7e1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:39.601643 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-834c6102-209d-4bcc-a0ed-b549058b7e1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:39.602105 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-834c6102-209d-4bcc-a0ed-b549058b7e1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:39.731278 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-834c6102-209d-4bcc-a0ed-b549058b7e1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:39.738922 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-834c6102-209d-4bcc-a0ed-b549058b7e1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1266 microversion: 2.1 time: 0.150939 Aug 24 11:44:39.739480 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 616/1249] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:39 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:40.760035 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-00f2ff7e-26f5-433e-abec-9d8ea9812f30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:40.760678 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-00f2ff7e-26f5-433e-abec-9d8ea9812f30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:40.763067 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=4 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:40.767895 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00f2ff7e-26f5-433e-abec-9d8ea9812f30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:40.768373 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00f2ff7e-26f5-433e-abec-9d8ea9812f30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:40.768803 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00f2ff7e-26f5-433e-abec-9d8ea9812f30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:40.769484 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00f2ff7e-26f5-433e-abec-9d8ea9812f30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:40.769968 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00f2ff7e-26f5-433e-abec-9d8ea9812f30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:40.770387 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00f2ff7e-26f5-433e-abec-9d8ea9812f30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:40.900126 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-00f2ff7e-26f5-433e-abec-9d8ea9812f30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:40.907873 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-00f2ff7e-26f5-433e-abec-9d8ea9812f30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1266 microversion: 2.1 time: 0.151654 Aug 24 11:44:40.908446 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 634/1250] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:40 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:41.928347 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-9fb20222-d8dc-4cb7-a28c-d2307df3c4ef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:41.928907 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-9fb20222-d8dc-4cb7-a28c-d2307df3c4ef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:41.931222 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=10 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:44:41.936226 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fb20222-d8dc-4cb7-a28c-d2307df3c4ef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:41.936702 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fb20222-d8dc-4cb7-a28c-d2307df3c4ef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:41.937165 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fb20222-d8dc-4cb7-a28c-d2307df3c4ef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:41.937847 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fb20222-d8dc-4cb7-a28c-d2307df3c4ef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:41.938310 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fb20222-d8dc-4cb7-a28c-d2307df3c4ef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:41.944734 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-9fb20222-d8dc-4cb7-a28c-d2307df3c4ef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:42.080580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-9fb20222-d8dc-4cb7-a28c-d2307df3c4ef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:42.088591 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-9fb20222-d8dc-4cb7-a28c-d2307df3c4ef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1266 microversion: 2.1 time: 0.164246 Aug 24 11:44:42.150515 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 617/1251] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:41 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:43.110856 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9ea5d409-6f29-41d2-b94a-4e15cf728798 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:43.111447 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9ea5d409-6f29-41d2-b94a-4e15cf728798 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:43.118408 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ea5d409-6f29-41d2-b94a-4e15cf728798 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:43.118892 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ea5d409-6f29-41d2-b94a-4e15cf728798 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:43.119326 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ea5d409-6f29-41d2-b94a-4e15cf728798 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:43.120018 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ea5d409-6f29-41d2-b94a-4e15cf728798 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:43.120471 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ea5d409-6f29-41d2-b94a-4e15cf728798 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:43.120886 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9ea5d409-6f29-41d2-b94a-4e15cf728798 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:43.251261 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9ea5d409-6f29-41d2-b94a-4e15cf728798 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:43.259153 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9ea5d409-6f29-41d2-b94a-4e15cf728798 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1266 microversion: 2.1 time: 0.152124 Aug 24 11:44:43.259718 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 635/1252] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:43 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:44.279090 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-747d2ca8-0789-46b5-ae87-b6478667e07d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:44.279727 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-747d2ca8-0789-46b5-ae87-b6478667e07d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:44.286274 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-747d2ca8-0789-46b5-ae87-b6478667e07d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:44.286795 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-747d2ca8-0789-46b5-ae87-b6478667e07d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:44.287179 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-747d2ca8-0789-46b5-ae87-b6478667e07d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:44.287868 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-747d2ca8-0789-46b5-ae87-b6478667e07d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:44.288844 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-747d2ca8-0789-46b5-ae87-b6478667e07d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:44.289257 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-747d2ca8-0789-46b5-ae87-b6478667e07d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:44.422284 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-747d2ca8-0789-46b5-ae87-b6478667e07d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:44.430093 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-747d2ca8-0789-46b5-ae87-b6478667e07d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1266 microversion: 2.1 time: 0.154780 Aug 24 11:44:44.430696 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 618/1253] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:44 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:45.459258 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-475b5a0d-102f-456f-94e8-211fb1434e8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:45.460489 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-475b5a0d-102f-456f-94e8-211fb1434e8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:45.467208 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-475b5a0d-102f-456f-94e8-211fb1434e8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:45.470416 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-475b5a0d-102f-456f-94e8-211fb1434e8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:45.470416 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-475b5a0d-102f-456f-94e8-211fb1434e8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:45.470416 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-475b5a0d-102f-456f-94e8-211fb1434e8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:45.470416 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-475b5a0d-102f-456f-94e8-211fb1434e8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:45.470846 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-475b5a0d-102f-456f-94e8-211fb1434e8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:45.604976 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-475b5a0d-102f-456f-94e8-211fb1434e8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:45.612840 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-475b5a0d-102f-456f-94e8-211fb1434e8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1266 microversion: 2.1 time: 0.157437 Aug 24 11:44:45.613402 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 636/1254] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:45 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:46.634969 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f565e842-d472-44ac-9299-38f9a5a3ac74 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:46.635573 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f565e842-d472-44ac-9299-38f9a5a3ac74 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:46.642362 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f565e842-d472-44ac-9299-38f9a5a3ac74 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:46.643389 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f565e842-d472-44ac-9299-38f9a5a3ac74 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:46.643389 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f565e842-d472-44ac-9299-38f9a5a3ac74 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:46.644065 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f565e842-d472-44ac-9299-38f9a5a3ac74 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:46.644510 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f565e842-d472-44ac-9299-38f9a5a3ac74 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:46.644923 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f565e842-d472-44ac-9299-38f9a5a3ac74 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:46.782643 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f565e842-d472-44ac-9299-38f9a5a3ac74 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:46.791053 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f565e842-d472-44ac-9299-38f9a5a3ac74 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1266 microversion: 2.1 time: 0.160820 Aug 24 11:44:46.791623 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 619/1255] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:46 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:47.812366 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bdc112d3-00e0-4012-a139-143a2dc56c23 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:47.812982 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bdc112d3-00e0-4012-a139-143a2dc56c23 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:47.820098 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bdc112d3-00e0-4012-a139-143a2dc56c23 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:47.820584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bdc112d3-00e0-4012-a139-143a2dc56c23 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:47.821025 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bdc112d3-00e0-4012-a139-143a2dc56c23 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:47.821717 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bdc112d3-00e0-4012-a139-143a2dc56c23 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:47.822212 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bdc112d3-00e0-4012-a139-143a2dc56c23 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:47.822639 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bdc112d3-00e0-4012-a139-143a2dc56c23 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:47.951929 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bdc112d3-00e0-4012-a139-143a2dc56c23 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:47.959751 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bdc112d3-00e0-4012-a139-143a2dc56c23 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1266 microversion: 2.1 time: 0.151271 Aug 24 11:44:47.960419 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 637/1256] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:47 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:48.370658 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-9e9644b9-289a-4c4d-952b-6f10c9945b20 req-3731faed-f68b-47b8-bca7-80657a41dcb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b77d1842-757c-4c5e-9187-54b891e4feee", "name": "network-vif-plugged", "status": "completed", "tag": "898b5481-c218-49ee-836f-a580e8508ed4"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:44:48.380351 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-9e9644b9-289a-4c4d-952b-6f10c9945b20 req-3731faed-f68b-47b8-bca7-80657a41dcb3 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:48.380824 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-9e9644b9-289a-4c4d-952b-6f10c9945b20 req-3731faed-f68b-47b8-bca7-80657a41dcb3 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:48.381246 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-9e9644b9-289a-4c4d-952b-6f10c9945b20 req-3731faed-f68b-47b8-bca7-80657a41dcb3 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:48.394676 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-9e9644b9-289a-4c4d-952b-6f10c9945b20 req-3731faed-f68b-47b8-bca7-80657a41dcb3 service nova] Creating event network-vif-plugged:898b5481-c218-49ee-836f-a580e8508ed4 for instance b77d1842-757c-4c5e-9187-54b891e4feee on hv-cinder-85427 Aug 24 11:44:48.400219 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-9e9644b9-289a-4c4d-952b-6f10c9945b20 req-3731faed-f68b-47b8-bca7-80657a41dcb3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092306 Aug 24 11:44:48.400894 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 620/1257] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:44:48.980163 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1359421b-63a6-4639-992b-c92f284decdc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:48.980814 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1359421b-63a6-4639-992b-c92f284decdc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:48.987384 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1359421b-63a6-4639-992b-c92f284decdc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:48.987872 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1359421b-63a6-4639-992b-c92f284decdc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:48.988315 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1359421b-63a6-4639-992b-c92f284decdc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:48.989116 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1359421b-63a6-4639-992b-c92f284decdc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:48.989574 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1359421b-63a6-4639-992b-c92f284decdc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:48.990035 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1359421b-63a6-4639-992b-c92f284decdc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:49.125297 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1359421b-63a6-4639-992b-c92f284decdc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:49.133596 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1359421b-63a6-4639-992b-c92f284decdc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1266 microversion: 2.1 time: 0.157345 Aug 24 11:44:49.134198 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 638/1258] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:48 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:50.155202 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4849f758-7305-4738-b81a-5ffc1b987324 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:50.155903 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4849f758-7305-4738-b81a-5ffc1b987324 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:50.162154 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4849f758-7305-4738-b81a-5ffc1b987324 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:50.162635 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4849f758-7305-4738-b81a-5ffc1b987324 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:50.163068 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4849f758-7305-4738-b81a-5ffc1b987324 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:50.163755 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4849f758-7305-4738-b81a-5ffc1b987324 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:50.164203 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4849f758-7305-4738-b81a-5ffc1b987324 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:50.164620 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4849f758-7305-4738-b81a-5ffc1b987324 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:50.303296 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4849f758-7305-4738-b81a-5ffc1b987324 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:50.312082 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4849f758-7305-4738-b81a-5ffc1b987324 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1266 microversion: 2.1 time: 0.161703 Aug 24 11:44:50.312880 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 621/1259] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:50 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:51.332438 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-756b3465-96de-4943-9a02-960eab9ddadb tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:51.333060 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-756b3465-96de-4943-9a02-960eab9ddadb tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:51.340062 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-756b3465-96de-4943-9a02-960eab9ddadb tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:51.340537 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-756b3465-96de-4943-9a02-960eab9ddadb tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:51.340966 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-756b3465-96de-4943-9a02-960eab9ddadb tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:51.341642 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-756b3465-96de-4943-9a02-960eab9ddadb tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:51.342115 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-756b3465-96de-4943-9a02-960eab9ddadb tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:51.342531 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-756b3465-96de-4943-9a02-960eab9ddadb tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:51.478647 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-756b3465-96de-4943-9a02-960eab9ddadb tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:51.486587 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-756b3465-96de-4943-9a02-960eab9ddadb tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1454 microversion: 2.1 time: 0.157955 Aug 24 11:44:51.487160 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 639/1260] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:51 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:51.507464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-52f8fc2b-fa0d-40ca-9214-89c96b0bad6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:44:51.508080 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-52f8fc2b-fa0d-40ca-9214-89c96b0bad6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:44:51.514562 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-52f8fc2b-fa0d-40ca-9214-89c96b0bad6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:51.515046 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-52f8fc2b-fa0d-40ca-9214-89c96b0bad6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:51.515505 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-52f8fc2b-fa0d-40ca-9214-89c96b0bad6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:51.516196 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-52f8fc2b-fa0d-40ca-9214-89c96b0bad6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:51.516649 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-52f8fc2b-fa0d-40ca-9214-89c96b0bad6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:51.517072 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-52f8fc2b-fa0d-40ca-9214-89c96b0bad6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:51.644877 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-52f8fc2b-fa0d-40ca-9214-89c96b0bad6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:44:51.652623 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-52f8fc2b-fa0d-40ca-9214-89c96b0bad6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1454 microversion: 2.1 time: 0.149601 Aug 24 11:44:51.653195 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 622/1261] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:44:51 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:44:53.465442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:44:53.466168 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Wed Aug 24 11:44:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:44:53.858836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-3e703d41-083c-49a6-9af3-e29b1a446a47 req-f65d106f-1f0d-483b-846f-9cdfc2214bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b77d1842-757c-4c5e-9187-54b891e4feee", "tag": "898b5481-c218-49ee-836f-a580e8508ed4"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:44:53.869373 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3e703d41-083c-49a6-9af3-e29b1a446a47 req-f65d106f-1f0d-483b-846f-9cdfc2214bc1 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:44:53.870060 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3e703d41-083c-49a6-9af3-e29b1a446a47 req-f65d106f-1f0d-483b-846f-9cdfc2214bc1 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:44:53.870596 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3e703d41-083c-49a6-9af3-e29b1a446a47 req-f65d106f-1f0d-483b-846f-9cdfc2214bc1 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:44:53.883661 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-3e703d41-083c-49a6-9af3-e29b1a446a47 req-f65d106f-1f0d-483b-846f-9cdfc2214bc1 service nova] Creating event network-changed:898b5481-c218-49ee-836f-a580e8508ed4 for instance b77d1842-757c-4c5e-9187-54b891e4feee on hv-cinder-85427 Aug 24 11:44:53.889021 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-3e703d41-083c-49a6-9af3-e29b1a446a47 req-f65d106f-1f0d-483b-846f-9cdfc2214bc1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033831 Aug 24 11:44:53.889685 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 640/1262] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:46:31.523885 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:46:31.524606 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:46:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:46:35.016768 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:46:35.017413 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:46:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:47:10.702265 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e139a8f9-e77e-4ea0-b998-782a213d56e4] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 11:47:10.703069 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:10.703821 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=58 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:10.707739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-82fc864e-7ebd-446a-b7b3-bb5307ce4ba1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:10.708568 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-82fc864e-7ebd-446a-b7b3-bb5307ce4ba1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:10.714084 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-82fc864e-7ebd-446a-b7b3-bb5307ce4ba1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:10.714567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-82fc864e-7ebd-446a-b7b3-bb5307ce4ba1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:10.715003 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-82fc864e-7ebd-446a-b7b3-bb5307ce4ba1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:10.715696 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-82fc864e-7ebd-446a-b7b3-bb5307ce4ba1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:10.716150 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-82fc864e-7ebd-446a-b7b3-bb5307ce4ba1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:10.716573 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-82fc864e-7ebd-446a-b7b3-bb5307ce4ba1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:10.742563 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-82fc864e-7ebd-446a-b7b3-bb5307ce4ba1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Going to try to terminate instance {{(pid=121222) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:47:11.109854 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-82fc864e-7ebd-446a-b7b3-bb5307ce4ba1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 204 len: 0 microversion: 2.1 time: 0.409269 Aug 24 11:47:11.110471 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 623/1263] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:47:10 2022] DELETE /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:47:11.116872 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97c81c84-e41c-4e1d-96da-f16e85ccbf56] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:47:11.119644 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=30 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:11.119644 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=58 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:11.122799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cf86aeeb-80c1-4203-a7d7-7f7045e1aa8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:11.123499 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cf86aeeb-80c1-4203-a7d7-7f7045e1aa8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:11.129571 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf86aeeb-80c1-4203-a7d7-7f7045e1aa8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:11.130094 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf86aeeb-80c1-4203-a7d7-7f7045e1aa8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:11.130530 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf86aeeb-80c1-4203-a7d7-7f7045e1aa8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:11.131219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf86aeeb-80c1-4203-a7d7-7f7045e1aa8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:11.131669 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf86aeeb-80c1-4203-a7d7-7f7045e1aa8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:11.132088 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf86aeeb-80c1-4203-a7d7-7f7045e1aa8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:11.322345 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cf86aeeb-80c1-4203-a7d7-7f7045e1aa8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:11.330509 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cf86aeeb-80c1-4203-a7d7-7f7045e1aa8f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1579 microversion: 2.1 time: 0.215316 Aug 24 11:47:11.331074 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 641/1264] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:11 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1579 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:12.352472 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a5ac6e70-0ad0-4191-bca9-f6644256a893 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:12.353171 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a5ac6e70-0ad0-4191-bca9-f6644256a893 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:12.362377 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a5ac6e70-0ad0-4191-bca9-f6644256a893 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:12.363442 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a5ac6e70-0ad0-4191-bca9-f6644256a893 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:12.363879 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a5ac6e70-0ad0-4191-bca9-f6644256a893 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:12.364572 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a5ac6e70-0ad0-4191-bca9-f6644256a893 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:12.365026 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a5ac6e70-0ad0-4191-bca9-f6644256a893 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:12.365475 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a5ac6e70-0ad0-4191-bca9-f6644256a893 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:12.371262 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO oslo.messaging._drivers.impl_rabbit [-] [e139a8f9-e77e-4ea0-b998-782a213d56e4] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 43442. Aug 24 11:47:12.558435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a5ac6e70-0ad0-4191-bca9-f6644256a893 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:12.566245 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a5ac6e70-0ad0-4191-bca9-f6644256a893 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1579 microversion: 2.1 time: 0.217999 Aug 24 11:47:12.566810 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 624/1265] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:12 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1579 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:13.587691 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e9ceca46-7636-4edc-9ce4-1d8b787b2a6a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:13.588305 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e9ceca46-7636-4edc-9ce4-1d8b787b2a6a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:13.599859 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] [97c81c84-e41c-4e1d-96da-f16e85ccbf56] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 43450. Aug 24 11:47:13.603998 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e9ceca46-7636-4edc-9ce4-1d8b787b2a6a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:13.604475 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e9ceca46-7636-4edc-9ce4-1d8b787b2a6a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:13.604906 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e9ceca46-7636-4edc-9ce4-1d8b787b2a6a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:13.605601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e9ceca46-7636-4edc-9ce4-1d8b787b2a6a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:13.606083 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e9ceca46-7636-4edc-9ce4-1d8b787b2a6a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:13.606501 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e9ceca46-7636-4edc-9ce4-1d8b787b2a6a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:13.805088 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e9ceca46-7636-4edc-9ce4-1d8b787b2a6a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:13.813077 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e9ceca46-7636-4edc-9ce4-1d8b787b2a6a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1579 microversion: 2.1 time: 0.229315 Aug 24 11:47:13.813650 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 642/1266] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:13 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1579 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:14.507207 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-6db51ae3-86cc-45fb-a8ff-0198ab2fd873 req-01c390f8-c7f1-403c-b12e-b31f6645bb14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b77d1842-757c-4c5e-9187-54b891e4feee", "name": "network-vif-deleted", "tag": "898b5481-c218-49ee-836f-a580e8508ed4"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:47:14.517516 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-6db51ae3-86cc-45fb-a8ff-0198ab2fd873 req-01c390f8-c7f1-403c-b12e-b31f6645bb14 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:14.518030 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-6db51ae3-86cc-45fb-a8ff-0198ab2fd873 req-01c390f8-c7f1-403c-b12e-b31f6645bb14 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:14.518457 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-6db51ae3-86cc-45fb-a8ff-0198ab2fd873 req-01c390f8-c7f1-403c-b12e-b31f6645bb14 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:14.530488 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-6db51ae3-86cc-45fb-a8ff-0198ab2fd873 req-01c390f8-c7f1-403c-b12e-b31f6645bb14 service nova] Creating event network-vif-deleted:898b5481-c218-49ee-836f-a580e8508ed4 for instance b77d1842-757c-4c5e-9187-54b891e4feee on hv-cinder-85427 Aug 24 11:47:14.536846 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-6db51ae3-86cc-45fb-a8ff-0198ab2fd873 req-01c390f8-c7f1-403c-b12e-b31f6645bb14 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033584 Aug 24 11:47:14.537481 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 625/1267] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:47:14.838833 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-651cce7c-0848-48e1-a327-bd9b53455093 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:14.839439 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-651cce7c-0848-48e1-a327-bd9b53455093 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:14.846079 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-651cce7c-0848-48e1-a327-bd9b53455093 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:14.846627 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-651cce7c-0848-48e1-a327-bd9b53455093 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:14.847087 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-651cce7c-0848-48e1-a327-bd9b53455093 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:14.847784 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-651cce7c-0848-48e1-a327-bd9b53455093 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:14.848238 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-651cce7c-0848-48e1-a327-bd9b53455093 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:14.848663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-651cce7c-0848-48e1-a327-bd9b53455093 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:14.914701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-651cce7c-0848-48e1-a327-bd9b53455093 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:14.922737 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-651cce7c-0848-48e1-a327-bd9b53455093 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1225 microversion: 2.1 time: 0.091372 Aug 24 11:47:14.923310 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 643/1268] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:14 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:15.945310 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-4758dd15-af19-4e5f-b6dc-5ef158e376b2 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:15.945947 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-4758dd15-af19-4e5f-b6dc-5ef158e376b2 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:15.952196 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4758dd15-af19-4e5f-b6dc-5ef158e376b2 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:15.952644 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4758dd15-af19-4e5f-b6dc-5ef158e376b2 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:15.953079 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4758dd15-af19-4e5f-b6dc-5ef158e376b2 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:15.953768 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4758dd15-af19-4e5f-b6dc-5ef158e376b2 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:15.954247 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4758dd15-af19-4e5f-b6dc-5ef158e376b2 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:15.954670 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4758dd15-af19-4e5f-b6dc-5ef158e376b2 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:15.991394 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4758dd15-af19-4e5f-b6dc-5ef158e376b2 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:15.991878 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4758dd15-af19-4e5f-b6dc-5ef158e376b2 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:15.992312 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-4758dd15-af19-4e5f-b6dc-5ef158e376b2 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:15.992820 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-4758dd15-af19-4e5f-b6dc-5ef158e376b2 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lazy-loading 'fault' on Instance uuid b77d1842-757c-4c5e-9187-54b891e4feee {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:47:16.036246 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-4758dd15-af19-4e5f-b6dc-5ef158e376b2 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:16.044841 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-4758dd15-af19-4e5f-b6dc-5ef158e376b2 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 200 len: 1184 microversion: 2.1 time: 0.104884 Aug 24 11:47:16.045431 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 626/1269] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:15 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 1184 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:17.066786 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bc5dcb3d-a9af-4256-81e7-016e8af251a4 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:17.067418 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bc5dcb3d-a9af-4256-81e7-016e8af251a4 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:17.073842 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bc5dcb3d-a9af-4256-81e7-016e8af251a4 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:17.074352 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bc5dcb3d-a9af-4256-81e7-016e8af251a4 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:17.074791 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bc5dcb3d-a9af-4256-81e7-016e8af251a4 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:17.075480 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bc5dcb3d-a9af-4256-81e7-016e8af251a4 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:17.075934 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bc5dcb3d-a9af-4256-81e7-016e8af251a4 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:17.076355 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bc5dcb3d-a9af-4256-81e7-016e8af251a4 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:17.089893 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-bc5dcb3d-a9af-4256-81e7-016e8af251a4 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] HTTP exception thrown: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bc5dcb3d-a9af-4256-81e7-016e8af251a4 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Request method failure captured: Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee HTTP/1.1 Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBg77MddKHUs2sTldK6Ry6JYMfyI49tEDKc3Iakf4He2S5HEScp72I7e8uUiRUNAlnllVWpcHsEcwDG5GZUdAcgj-3t7HTK4NM7dIwN5OrdMec2RAtv-Xgz0Hv6ObhyWiu6aVlJNJgMjlx6aF25_mHTx8Zns42si6uF5-oPECnDq8djg Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 548b5e4f59b24f0a9b88bf125c8a19a8 Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:47:17.091523 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:47:17.093343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_548b5e4f59b24f0a9b88bf125c8a19a8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:47:17.093343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:47:17.093343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 548b5e4f59b24f0a9b88bf125c8a19a8 Aug 24 11:47:17.093343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:47:17.093343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-TestVolumeBootPattern-1426993665-project Aug 24 11:47:17.093343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:47:17.093343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:47:17.093343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 4edfa99b10014e8289697a255d8b90cf Aug 24 11:47:17.093343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-TestVolumeBootPattern-1426993665-project Aug 24 11:47:17.093343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:47:17.093343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:47:17.093343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': 'b77d1842-757c-4c5e-9187-54b891e4feee'} Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:47:17.094593 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:47:17.096300 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:47:17.098534 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bc5dcb3d-a9af-4256-81e7-016e8af251a4 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Returning 404 to user: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:47:17.098534 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bc5dcb3d-a9af-4256-81e7-016e8af251a4 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 404 len: 111 microversion: 2.1 time: 0.030052 Aug 24 11:47:17.098534 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 644/1270] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:17 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:47:17.140876 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-751260298", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1093131630", "security_groups": [{"name": "tempest-secgroup-smoke-1686689868"}], "block_device_mapping_v2": [{"uuid": "42544db9-f20e-4fe8-86e7-ddbe3d486cf2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ef9e4d00-e993-40b5-ae2f-15a637a6c58e"}]}} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:47:17.253927 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.network.neutron [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] validate_networks() for [('ef9e4d00-e993-40b5-ae2f-15a637a6c58e', None, None, None, None, None)] {{(pid=121222) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:47:17.626030 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Flavor limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:47:17.626478 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Image limits 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:47:17.626949 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Flavor pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:47:17.627353 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Image pref 0:0:0 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:47:17.627778 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.virt.hardware [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121222) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:47:17.636561 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:17.637039 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:17.637469 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:17.638231 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:17.638685 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:17.639110 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:17.655619 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Getting quotas for project 548b5e4f59b24f0a9b88bf125c8a19a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:47:17.659998 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.quota [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Getting quotas for user 4edfa99b10014e8289697a255d8b90cf and project 548b5e4f59b24f0a9b88bf125c8a19a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121222) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:47:17.716524 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Going to run 1 instances... {{(pid=121222) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:47:17.718750 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='42544db9-f20e-4fe8-86e7-ddbe3d486cf2',volume_size=None,volume_type=None)] {{(pid=121222) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:47:18.140304 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-64da6d7f-46ad-43a1-8d6a-12cad4f70301 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.003170 Aug 24 11:47:18.140963 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 627/1271] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:47:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:47:18.152542 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4df30239-c528-4864-adde-36a31808634b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:18.153223 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4df30239-c528-4864-adde-36a31808634b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:18.210143 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4df30239-c528-4864-adde-36a31808634b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:18.218968 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4df30239-c528-4864-adde-36a31808634b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1094 microversion: 2.1 time: 0.070378 Aug 24 11:47:18.219540 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 645/1272] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:18 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:19.239859 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-bb77b072-c250-466e-8427-122d2fb9cb45 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:19.240479 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-bb77b072-c250-466e-8427-122d2fb9cb45 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:19.247406 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb77b072-c250-466e-8427-122d2fb9cb45 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:19.247899 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb77b072-c250-466e-8427-122d2fb9cb45 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:19.248332 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb77b072-c250-466e-8427-122d2fb9cb45 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:19.249117 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb77b072-c250-466e-8427-122d2fb9cb45 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:19.249481 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb77b072-c250-466e-8427-122d2fb9cb45 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:19.249930 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-bb77b072-c250-466e-8427-122d2fb9cb45 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:19.312463 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-bb77b072-c250-466e-8427-122d2fb9cb45 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:19.320466 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-bb77b072-c250-466e-8427-122d2fb9cb45 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1144 microversion: 2.1 time: 0.084956 Aug 24 11:47:19.325656 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 628/1273] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:19 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:20.341005 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e4318bb6-cb0c-44cc-bdd3-ff6164c2fbcc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:20.341642 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e4318bb6-cb0c-44cc-bdd3-ff6164c2fbcc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:20.348696 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e4318bb6-cb0c-44cc-bdd3-ff6164c2fbcc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:20.354380 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e4318bb6-cb0c-44cc-bdd3-ff6164c2fbcc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:20.354380 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e4318bb6-cb0c-44cc-bdd3-ff6164c2fbcc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:20.354380 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e4318bb6-cb0c-44cc-bdd3-ff6164c2fbcc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:20.354380 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e4318bb6-cb0c-44cc-bdd3-ff6164c2fbcc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:20.354808 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e4318bb6-cb0c-44cc-bdd3-ff6164c2fbcc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:20.426508 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e4318bb6-cb0c-44cc-bdd3-ff6164c2fbcc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:20.434888 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e4318bb6-cb0c-44cc-bdd3-ff6164c2fbcc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1200 microversion: 2.1 time: 0.097807 Aug 24 11:47:20.435468 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 646/1274] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:20 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1200 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:21.461860 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-f098b9c2-d23b-45f4-adc2-383c01cf5bf5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:21.463652 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-f098b9c2-d23b-45f4-adc2-383c01cf5bf5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:21.471739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f098b9c2-d23b-45f4-adc2-383c01cf5bf5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:21.473560 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f098b9c2-d23b-45f4-adc2-383c01cf5bf5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:21.474257 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f098b9c2-d23b-45f4-adc2-383c01cf5bf5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:21.475579 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f098b9c2-d23b-45f4-adc2-383c01cf5bf5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:21.476351 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f098b9c2-d23b-45f4-adc2-383c01cf5bf5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:21.477045 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-f098b9c2-d23b-45f4-adc2-383c01cf5bf5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:21.618654 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-f098b9c2-d23b-45f4-adc2-383c01cf5bf5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:21.626626 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-f098b9c2-d23b-45f4-adc2-383c01cf5bf5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1278 microversion: 2.1 time: 0.169000 Aug 24 11:47:21.627198 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 629/1275] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:21 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:22.179878 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-2271e888-d7c6-4f72-8d09-8d6425587796 req-4fade52c-6106-49b6-934e-04ce55f51b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "021bccdc-e3c1-4152-a08a-486eca7a7993", "tag": "a5612f11-8f9a-48ae-bb0f-1486a455d7e2"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:47:22.192415 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2271e888-d7c6-4f72-8d09-8d6425587796 req-4fade52c-6106-49b6-934e-04ce55f51b66 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:22.192810 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2271e888-d7c6-4f72-8d09-8d6425587796 req-4fade52c-6106-49b6-934e-04ce55f51b66 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:22.193232 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2271e888-d7c6-4f72-8d09-8d6425587796 req-4fade52c-6106-49b6-934e-04ce55f51b66 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:22.204923 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-2271e888-d7c6-4f72-8d09-8d6425587796 req-4fade52c-6106-49b6-934e-04ce55f51b66 service nova] Creating event network-changed:a5612f11-8f9a-48ae-bb0f-1486a455d7e2 for instance 021bccdc-e3c1-4152-a08a-486eca7a7993 on hv-cinder-85427 Aug 24 11:47:22.211298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-2271e888-d7c6-4f72-8d09-8d6425587796 req-4fade52c-6106-49b6-934e-04ce55f51b66 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034763 Aug 24 11:47:22.211917 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 647/1276] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:47:22.648584 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-a7fef43d-2daa-4d22-abb4-56fa6e12afe5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:22.649201 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-a7fef43d-2daa-4d22-abb4-56fa6e12afe5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:22.658177 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7fef43d-2daa-4d22-abb4-56fa6e12afe5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:22.658723 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7fef43d-2daa-4d22-abb4-56fa6e12afe5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:22.659168 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7fef43d-2daa-4d22-abb4-56fa6e12afe5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:22.660384 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7fef43d-2daa-4d22-abb4-56fa6e12afe5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:22.660838 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7fef43d-2daa-4d22-abb4-56fa6e12afe5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:22.661260 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-a7fef43d-2daa-4d22-abb4-56fa6e12afe5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:22.794688 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-a7fef43d-2daa-4d22-abb4-56fa6e12afe5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:22.803074 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-a7fef43d-2daa-4d22-abb4-56fa6e12afe5 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1266 microversion: 2.1 time: 0.158346 Aug 24 11:47:22.803649 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 630/1277] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:22 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:23.824296 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a296d0e3-faac-4c03-97d2-5d4861b0c19d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:23.825011 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a296d0e3-faac-4c03-97d2-5d4861b0c19d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:23.831656 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a296d0e3-faac-4c03-97d2-5d4861b0c19d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:23.832557 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a296d0e3-faac-4c03-97d2-5d4861b0c19d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:23.833009 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a296d0e3-faac-4c03-97d2-5d4861b0c19d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:23.833701 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a296d0e3-faac-4c03-97d2-5d4861b0c19d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:23.834453 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a296d0e3-faac-4c03-97d2-5d4861b0c19d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:23.834891 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a296d0e3-faac-4c03-97d2-5d4861b0c19d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:23.966719 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a296d0e3-faac-4c03-97d2-5d4861b0c19d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:23.974494 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a296d0e3-faac-4c03-97d2-5d4861b0c19d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1266 microversion: 2.1 time: 0.154464 Aug 24 11:47:23.975077 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 648/1278] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:23 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:24.995883 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-730ea5f9-8fac-4dd0-8ed7-9ba8dc101cef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:24.996528 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-730ea5f9-8fac-4dd0-8ed7-9ba8dc101cef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:25.003470 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-730ea5f9-8fac-4dd0-8ed7-9ba8dc101cef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:25.003962 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-730ea5f9-8fac-4dd0-8ed7-9ba8dc101cef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:25.004391 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-730ea5f9-8fac-4dd0-8ed7-9ba8dc101cef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:25.005070 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-730ea5f9-8fac-4dd0-8ed7-9ba8dc101cef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:25.005517 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-730ea5f9-8fac-4dd0-8ed7-9ba8dc101cef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:25.005962 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-730ea5f9-8fac-4dd0-8ed7-9ba8dc101cef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:25.138942 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-730ea5f9-8fac-4dd0-8ed7-9ba8dc101cef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:25.147618 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-730ea5f9-8fac-4dd0-8ed7-9ba8dc101cef tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1266 microversion: 2.1 time: 0.155758 Aug 24 11:47:25.148205 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 631/1279] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:24 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:26.167798 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-819f5427-7ba1-4357-bccf-2c951be8c6a3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:26.168422 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-819f5427-7ba1-4357-bccf-2c951be8c6a3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:26.175100 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-819f5427-7ba1-4357-bccf-2c951be8c6a3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:26.175581 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-819f5427-7ba1-4357-bccf-2c951be8c6a3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:26.176016 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-819f5427-7ba1-4357-bccf-2c951be8c6a3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:26.177191 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-819f5427-7ba1-4357-bccf-2c951be8c6a3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:26.177644 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-819f5427-7ba1-4357-bccf-2c951be8c6a3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:26.178119 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-819f5427-7ba1-4357-bccf-2c951be8c6a3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:26.311509 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-819f5427-7ba1-4357-bccf-2c951be8c6a3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:26.319264 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-819f5427-7ba1-4357-bccf-2c951be8c6a3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1266 microversion: 2.1 time: 0.155402 Aug 24 11:47:26.319839 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 649/1280] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:26 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:27.342580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3fc1e583-501a-4b28-8efb-9a4110c8203d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:27.343200 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3fc1e583-501a-4b28-8efb-9a4110c8203d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:27.350591 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fc1e583-501a-4b28-8efb-9a4110c8203d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:27.351003 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fc1e583-501a-4b28-8efb-9a4110c8203d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:27.351433 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fc1e583-501a-4b28-8efb-9a4110c8203d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:27.352426 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fc1e583-501a-4b28-8efb-9a4110c8203d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:27.352875 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fc1e583-501a-4b28-8efb-9a4110c8203d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:27.353322 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-3fc1e583-501a-4b28-8efb-9a4110c8203d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:27.483267 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3fc1e583-501a-4b28-8efb-9a4110c8203d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:27.491675 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3fc1e583-501a-4b28-8efb-9a4110c8203d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1266 microversion: 2.1 time: 0.154491 Aug 24 11:47:27.492262 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 632/1281] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:27 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:28.512859 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-76256591-334b-4539-8c26-8004b47207d1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:28.513479 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-76256591-334b-4539-8c26-8004b47207d1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:28.515937 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:28.520786 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76256591-334b-4539-8c26-8004b47207d1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:28.521266 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76256591-334b-4539-8c26-8004b47207d1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:28.521707 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76256591-334b-4539-8c26-8004b47207d1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:28.522428 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76256591-334b-4539-8c26-8004b47207d1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:28.522886 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76256591-334b-4539-8c26-8004b47207d1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:28.523312 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-76256591-334b-4539-8c26-8004b47207d1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:28.654807 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-76256591-334b-4539-8c26-8004b47207d1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:28.663092 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-76256591-334b-4539-8c26-8004b47207d1 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1266 microversion: 2.1 time: 0.154060 Aug 24 11:47:28.665480 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 650/1282] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:28 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:29.683674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-d4f90490-a514-42d0-90d1-c399655d2b9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:29.684218 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-d4f90490-a514-42d0-90d1-c399655d2b9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:29.686192 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=2 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:29.686857 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=6 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:47:29.692895 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d4f90490-a514-42d0-90d1-c399655d2b9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:29.693379 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d4f90490-a514-42d0-90d1-c399655d2b9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:29.693821 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d4f90490-a514-42d0-90d1-c399655d2b9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:29.694546 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d4f90490-a514-42d0-90d1-c399655d2b9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:29.694999 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d4f90490-a514-42d0-90d1-c399655d2b9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:29.695451 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-d4f90490-a514-42d0-90d1-c399655d2b9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:29.827188 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-d4f90490-a514-42d0-90d1-c399655d2b9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:29.834881 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-d4f90490-a514-42d0-90d1-c399655d2b9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1266 microversion: 2.1 time: 0.155162 Aug 24 11:47:29.835452 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 633/1283] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:29 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 11:47:30.855911 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dc936f7d-121c-479e-95ac-ddd4cc2d0495 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:30.856534 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-dc936f7d-121c-479e-95ac-ddd4cc2d0495 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:30.862981 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc936f7d-121c-479e-95ac-ddd4cc2d0495 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:30.863466 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc936f7d-121c-479e-95ac-ddd4cc2d0495 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:30.863902 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc936f7d-121c-479e-95ac-ddd4cc2d0495 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:30.864591 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc936f7d-121c-479e-95ac-ddd4cc2d0495 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:30.865045 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc936f7d-121c-479e-95ac-ddd4cc2d0495 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:30.865475 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc936f7d-121c-479e-95ac-ddd4cc2d0495 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:31.000950 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dc936f7d-121c-479e-95ac-ddd4cc2d0495 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:31.009923 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-dc936f7d-121c-479e-95ac-ddd4cc2d0495 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1266 microversion: 2.1 time: 0.157851 Aug 24 11:47:31.010541 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 651/1284] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:30 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:32.031501 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-38fda395-6c2a-463e-8a0d-9de4a00d219e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:32.032168 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-38fda395-6c2a-463e-8a0d-9de4a00d219e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:32.038982 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-38fda395-6c2a-463e-8a0d-9de4a00d219e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:32.039463 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-38fda395-6c2a-463e-8a0d-9de4a00d219e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:32.039890 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-38fda395-6c2a-463e-8a0d-9de4a00d219e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:32.040586 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-38fda395-6c2a-463e-8a0d-9de4a00d219e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:32.041035 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-38fda395-6c2a-463e-8a0d-9de4a00d219e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:32.041455 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-38fda395-6c2a-463e-8a0d-9de4a00d219e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:32.194771 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-38fda395-6c2a-463e-8a0d-9de4a00d219e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:32.202476 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-38fda395-6c2a-463e-8a0d-9de4a00d219e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1266 microversion: 2.1 time: 0.175327 Aug 24 11:47:32.203049 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 634/1285] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:32 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:33.223528 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c699247a-32fa-4141-b02e-734d10926edc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:33.224213 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c699247a-32fa-4141-b02e-734d10926edc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:33.230274 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c699247a-32fa-4141-b02e-734d10926edc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:33.230767 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c699247a-32fa-4141-b02e-734d10926edc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:33.231193 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c699247a-32fa-4141-b02e-734d10926edc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:33.231886 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c699247a-32fa-4141-b02e-734d10926edc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:33.232331 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c699247a-32fa-4141-b02e-734d10926edc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:33.232743 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c699247a-32fa-4141-b02e-734d10926edc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:33.250904 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-97b1e022-897e-4dbd-8832-31a9b536f1dc req-92af48f0-f3c3-492d-9469-40cc29e1e77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021bccdc-e3c1-4152-a08a-486eca7a7993", "name": "network-vif-plugged", "status": "completed", "tag": "a5612f11-8f9a-48ae-bb0f-1486a455d7e2"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:47:33.261756 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-97b1e022-897e-4dbd-8832-31a9b536f1dc req-92af48f0-f3c3-492d-9469-40cc29e1e77b service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:33.262255 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-97b1e022-897e-4dbd-8832-31a9b536f1dc req-92af48f0-f3c3-492d-9469-40cc29e1e77b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:33.262670 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-97b1e022-897e-4dbd-8832-31a9b536f1dc req-92af48f0-f3c3-492d-9469-40cc29e1e77b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:33.274526 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-97b1e022-897e-4dbd-8832-31a9b536f1dc req-92af48f0-f3c3-492d-9469-40cc29e1e77b service nova] Creating event network-vif-plugged:a5612f11-8f9a-48ae-bb0f-1486a455d7e2 for instance 021bccdc-e3c1-4152-a08a-486eca7a7993 on hv-cinder-85427 Aug 24 11:47:33.280073 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-97b1e022-897e-4dbd-8832-31a9b536f1dc req-92af48f0-f3c3-492d-9469-40cc29e1e77b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032780 Aug 24 11:47:33.280858 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 635/1286] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:47:33.376594 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c699247a-32fa-4141-b02e-734d10926edc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:33.385017 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c699247a-32fa-4141-b02e-734d10926edc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1266 microversion: 2.1 time: 0.166158 Aug 24 11:47:33.385603 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 652/1287] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:33 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:34.407801 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2ba77604-8e5f-43e2-894d-967ec6999262 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:34.408509 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-2ba77604-8e5f-43e2-894d-967ec6999262 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:34.415386 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2ba77604-8e5f-43e2-894d-967ec6999262 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:34.415870 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2ba77604-8e5f-43e2-894d-967ec6999262 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:34.416303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2ba77604-8e5f-43e2-894d-967ec6999262 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:34.416996 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2ba77604-8e5f-43e2-894d-967ec6999262 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:34.417441 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2ba77604-8e5f-43e2-894d-967ec6999262 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:34.417865 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2ba77604-8e5f-43e2-894d-967ec6999262 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:34.548276 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-2ba77604-8e5f-43e2-894d-967ec6999262 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:34.556365 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-2ba77604-8e5f-43e2-894d-967ec6999262 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1266 microversion: 2.1 time: 0.153272 Aug 24 11:47:34.557006 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 636/1288] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:34 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:35.576765 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5aba299a-647d-453d-95d4-6421e5f245fc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:35.577335 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5aba299a-647d-453d-95d4-6421e5f245fc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:35.583813 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5aba299a-647d-453d-95d4-6421e5f245fc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:35.584324 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5aba299a-647d-453d-95d4-6421e5f245fc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:35.584755 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5aba299a-647d-453d-95d4-6421e5f245fc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:35.585454 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5aba299a-647d-453d-95d4-6421e5f245fc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:35.585922 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5aba299a-647d-453d-95d4-6421e5f245fc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:35.586350 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5aba299a-647d-453d-95d4-6421e5f245fc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:35.721167 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5aba299a-647d-453d-95d4-6421e5f245fc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:35.729602 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5aba299a-647d-453d-95d4-6421e5f245fc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1266 microversion: 2.1 time: 0.156827 Aug 24 11:47:35.730213 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 653/1289] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:35 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:36.749833 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-077e5603-8e55-4a76-a108-d35bf6100624 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:36.750445 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-077e5603-8e55-4a76-a108-d35bf6100624 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:36.757053 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-077e5603-8e55-4a76-a108-d35bf6100624 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:36.757540 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-077e5603-8e55-4a76-a108-d35bf6100624 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:36.758015 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-077e5603-8e55-4a76-a108-d35bf6100624 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:36.758717 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-077e5603-8e55-4a76-a108-d35bf6100624 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:36.759169 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-077e5603-8e55-4a76-a108-d35bf6100624 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:36.759599 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-077e5603-8e55-4a76-a108-d35bf6100624 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:36.892124 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-077e5603-8e55-4a76-a108-d35bf6100624 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:36.900486 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-077e5603-8e55-4a76-a108-d35bf6100624 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1453 microversion: 2.1 time: 0.154599 Aug 24 11:47:36.901056 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 637/1290] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:36 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:36.919813 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-acec558a-0cdd-4588-89da-2f55d9e6387d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:47:36.920428 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-acec558a-0cdd-4588-89da-2f55d9e6387d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:47:36.926752 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-acec558a-0cdd-4588-89da-2f55d9e6387d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:36.927259 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-acec558a-0cdd-4588-89da-2f55d9e6387d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:36.927692 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-acec558a-0cdd-4588-89da-2f55d9e6387d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:36.928373 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-acec558a-0cdd-4588-89da-2f55d9e6387d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:36.928824 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-acec558a-0cdd-4588-89da-2f55d9e6387d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:36.929243 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-acec558a-0cdd-4588-89da-2f55d9e6387d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:37.056558 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-acec558a-0cdd-4588-89da-2f55d9e6387d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:47:37.064234 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-acec558a-0cdd-4588-89da-2f55d9e6387d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1453 microversion: 2.1 time: 0.148202 Aug 24 11:47:37.064825 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 654/1291] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:47:36 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:47:39.229088 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-60b01c07-f111-4879-8f66-92722eab8fa7 req-dbb6f97b-7b25-47da-9a05-2f61947193b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "021bccdc-e3c1-4152-a08a-486eca7a7993", "tag": "a5612f11-8f9a-48ae-bb0f-1486a455d7e2"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:47:39.239051 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-60b01c07-f111-4879-8f66-92722eab8fa7 req-dbb6f97b-7b25-47da-9a05-2f61947193b5 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:47:39.240097 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-60b01c07-f111-4879-8f66-92722eab8fa7 req-dbb6f97b-7b25-47da-9a05-2f61947193b5 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:47:39.240527 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-60b01c07-f111-4879-8f66-92722eab8fa7 req-dbb6f97b-7b25-47da-9a05-2f61947193b5 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:47:39.252243 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-60b01c07-f111-4879-8f66-92722eab8fa7 req-dbb6f97b-7b25-47da-9a05-2f61947193b5 service nova] Creating event network-changed:a5612f11-8f9a-48ae-bb0f-1486a455d7e2 for instance 021bccdc-e3c1-4152-a08a-486eca7a7993 on hv-cinder-85427 Aug 24 11:47:39.257539 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-60b01c07-f111-4879-8f66-92722eab8fa7 req-dbb6f97b-7b25-47da-9a05-2f61947193b5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032090 Aug 24 11:47:39.258463 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 638/1292] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:48:13.474483 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:48:13.475210 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Wed Aug 24 11:48:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:49:42.750765 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=30 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:42.751486 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=70 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:42.755537 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1776953299", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1093131630", "security_groups": [{"name": "tempest-secgroup-smoke-1686689868"}], "block_device_mapping_v2": [{"uuid": "1c8b794d-ddcf-4774-b714-5c7221838d5b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ef9e4d00-e993-40b5-ae2f-15a637a6c58e"}]}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:49:42.868851 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] validate_networks() for [('ef9e4d00-e993-40b5-ae2f-15a637a6c58e', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 11:49:43.298312 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 11:49:43.298738 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 11:49:43.299215 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 11:49:43.299631 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 11:49:43.300042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 11:49:43.308711 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:43.309188 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:43.309619 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:43.310387 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:43.310840 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:43.311262 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:43.328844 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Getting quotas for project 548b5e4f59b24f0a9b88bf125c8a19a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 11:49:43.333347 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Getting quotas for user 4edfa99b10014e8289697a255d8b90cf and project 548b5e4f59b24f0a9b88bf125c8a19a8. Resources: {'cores', 'instances', 'ram'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 11:49:43.389788 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 11:49:43.391933 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c8b794d-ddcf-4774-b714-5c7221838d5b',volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 11:49:43.819435 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [db1e8153-13b7-44aa-974e-856a84f40458] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 11:49:44.826946 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [db1e8153-13b7-44aa-974e-856a84f40458] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 43616. Aug 24 11:49:44.834162 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b4341038-ff50-4161-b860-6f1b35e0ba9f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.085171 Aug 24 11:49:44.834885 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 655/1293] 10.222.0.83 () {60 vars in 1147 bytes} [Wed Aug 24 11:49:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 11:49:44.844328 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:44.850749 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:44.850749 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-3c431f55-6a8f-4694-923b-8f966247a12f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:44.851118 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-3c431f55-6a8f-4694-923b-8f966247a12f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:44.904843 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-3c431f55-6a8f-4694-923b-8f966247a12f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:44.912506 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-3c431f55-6a8f-4694-923b-8f966247a12f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1095 microversion: 2.1 time: 0.070447 Aug 24 11:49:44.913074 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 639/1294] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:44 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:45.932980 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f82bc916-084c-41a2-ae58-c93799fc0665 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:45.933605 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f82bc916-084c-41a2-ae58-c93799fc0665 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:45.988281 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f82bc916-084c-41a2-ae58-c93799fc0665 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:45.995623 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f82bc916-084c-41a2-ae58-c93799fc0665 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1095 microversion: 2.1 time: 0.067016 Aug 24 11:49:45.996182 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 656/1295] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:45 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:47.016566 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-167fe929-5fec-473a-bd05-a3378c36a100 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:47.017189 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-167fe929-5fec-473a-bd05-a3378c36a100 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:47.076585 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-167fe929-5fec-473a-bd05-a3378c36a100 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:47.083609 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-167fe929-5fec-473a-bd05-a3378c36a100 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1095 microversion: 2.1 time: 0.071684 Aug 24 11:49:47.084388 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 640/1296] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:47 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:48.104118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2b5d2eb7-c83b-4afb-b89e-0d8380a84f08 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:48.104670 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2b5d2eb7-c83b-4afb-b89e-0d8380a84f08 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:48.156296 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2b5d2eb7-c83b-4afb-b89e-0d8380a84f08 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:48.163582 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2b5d2eb7-c83b-4afb-b89e-0d8380a84f08 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1095 microversion: 2.1 time: 0.063412 Aug 24 11:49:48.164140 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 657/1297] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:48 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:49.187019 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b0c4278c-5af9-46f4-9641-cf7b7f50bb6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:49.187606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b0c4278c-5af9-46f4-9641-cf7b7f50bb6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:49.198977 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0c4278c-5af9-46f4-9641-cf7b7f50bb6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:49.199535 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0c4278c-5af9-46f4-9641-cf7b7f50bb6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:49.199983 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0c4278c-5af9-46f4-9641-cf7b7f50bb6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:49.200693 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0c4278c-5af9-46f4-9641-cf7b7f50bb6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:49.201173 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0c4278c-5af9-46f4-9641-cf7b7f50bb6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:49.201618 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b0c4278c-5af9-46f4-9641-cf7b7f50bb6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:49.270521 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-b0c4278c-5af9-46f4-9641-cf7b7f50bb6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:49.279976 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b0c4278c-5af9-46f4-9641-cf7b7f50bb6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1145 microversion: 2.1 time: 0.097295 Aug 24 11:49:49.280589 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 641/1298] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:49 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1145 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:50.300646 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f57785d2-cc06-4968-a928-26a4d31f2f6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:50.301402 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f57785d2-cc06-4968-a928-26a4d31f2f6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:50.308971 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f57785d2-cc06-4968-a928-26a4d31f2f6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:50.309456 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f57785d2-cc06-4968-a928-26a4d31f2f6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:50.309898 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f57785d2-cc06-4968-a928-26a4d31f2f6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:50.310634 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f57785d2-cc06-4968-a928-26a4d31f2f6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:50.311078 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f57785d2-cc06-4968-a928-26a4d31f2f6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:50.311490 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f57785d2-cc06-4968-a928-26a4d31f2f6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:50.374487 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f57785d2-cc06-4968-a928-26a4d31f2f6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:50.382818 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f57785d2-cc06-4968-a928-26a4d31f2f6f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1137 microversion: 2.1 time: 0.086154 Aug 24 11:49:50.383390 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 658/1299] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:50 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:51.402950 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-cc7c229b-131a-492b-aadb-2255ceb2b3ab tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:51.403553 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-cc7c229b-131a-492b-aadb-2255ceb2b3ab tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:51.410865 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cc7c229b-131a-492b-aadb-2255ceb2b3ab tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:51.411674 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cc7c229b-131a-492b-aadb-2255ceb2b3ab tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:51.412175 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cc7c229b-131a-492b-aadb-2255ceb2b3ab tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:51.412828 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cc7c229b-131a-492b-aadb-2255ceb2b3ab tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:51.413275 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cc7c229b-131a-492b-aadb-2255ceb2b3ab tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:51.413690 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-cc7c229b-131a-492b-aadb-2255ceb2b3ab tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:51.481289 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-cc7c229b-131a-492b-aadb-2255ceb2b3ab tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:51.489619 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-cc7c229b-131a-492b-aadb-2255ceb2b3ab tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1211 microversion: 2.1 time: 0.090621 Aug 24 11:49:51.490663 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 642/1300] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:51 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:51.532251 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:49:51.532920 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:49:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:49:52.510816 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f1bded12-8ff9-421a-8e91-52e01ac75e61 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:52.511436 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f1bded12-8ff9-421a-8e91-52e01ac75e61 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:52.518041 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1bded12-8ff9-421a-8e91-52e01ac75e61 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:52.521540 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1bded12-8ff9-421a-8e91-52e01ac75e61 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:52.521540 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1bded12-8ff9-421a-8e91-52e01ac75e61 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:52.521540 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1bded12-8ff9-421a-8e91-52e01ac75e61 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:52.521540 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1bded12-8ff9-421a-8e91-52e01ac75e61 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:52.522099 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1bded12-8ff9-421a-8e91-52e01ac75e61 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:52.661082 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f1bded12-8ff9-421a-8e91-52e01ac75e61 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:52.668990 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f1bded12-8ff9-421a-8e91-52e01ac75e61 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1279 microversion: 2.1 time: 0.162000 Aug 24 11:49:52.682094 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 659/1301] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:52 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:53.036798 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-fef2db84-fa80-4e26-a00b-14f818f11cf2 req-3b48f70f-46ed-4b3b-89ce-7b23e48ea142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cb2c70-45e6-4578-8370-7da09c6acb86", "tag": "889630d5-cb13-47d3-b0e3-1b043412adb6"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:49:53.046265 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fef2db84-fa80-4e26-a00b-14f818f11cf2 req-3b48f70f-46ed-4b3b-89ce-7b23e48ea142 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:53.053122 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fef2db84-fa80-4e26-a00b-14f818f11cf2 req-3b48f70f-46ed-4b3b-89ce-7b23e48ea142 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:53.053122 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fef2db84-fa80-4e26-a00b-14f818f11cf2 req-3b48f70f-46ed-4b3b-89ce-7b23e48ea142 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:53.058614 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-fef2db84-fa80-4e26-a00b-14f818f11cf2 req-3b48f70f-46ed-4b3b-89ce-7b23e48ea142 service nova] Creating event network-changed:889630d5-cb13-47d3-b0e3-1b043412adb6 for instance 26cb2c70-45e6-4578-8370-7da09c6acb86 on hv-cinder-85427 Aug 24 11:49:53.063543 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-fef2db84-fa80-4e26-a00b-14f818f11cf2 req-3b48f70f-46ed-4b3b-89ce-7b23e48ea142 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087824 Aug 24 11:49:53.064126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 643/1302] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:49:53.689838 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3f829fc9-1059-4225-9d66-f07405dc3d30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:53.690584 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3f829fc9-1059-4225-9d66-f07405dc3d30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:53.692463 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:53.697715 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f829fc9-1059-4225-9d66-f07405dc3d30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:53.698244 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f829fc9-1059-4225-9d66-f07405dc3d30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:53.698682 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f829fc9-1059-4225-9d66-f07405dc3d30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:53.699377 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f829fc9-1059-4225-9d66-f07405dc3d30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:53.699829 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f829fc9-1059-4225-9d66-f07405dc3d30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:53.700250 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f829fc9-1059-4225-9d66-f07405dc3d30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:53.914544 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3f829fc9-1059-4225-9d66-f07405dc3d30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:53.922195 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3f829fc9-1059-4225-9d66-f07405dc3d30 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1267 microversion: 2.1 time: 0.236162 Aug 24 11:49:53.927073 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 660/1303] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:53 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:54.944583 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-2aaac002-8fec-4988-9d13-9ecdc7822ca9 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:54.945280 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-2aaac002-8fec-4988-9d13-9ecdc7822ca9 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:54.951577 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2aaac002-8fec-4988-9d13-9ecdc7822ca9 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:54.952050 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2aaac002-8fec-4988-9d13-9ecdc7822ca9 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:54.952479 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2aaac002-8fec-4988-9d13-9ecdc7822ca9 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:54.953162 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2aaac002-8fec-4988-9d13-9ecdc7822ca9 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:54.953606 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2aaac002-8fec-4988-9d13-9ecdc7822ca9 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:54.954043 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-2aaac002-8fec-4988-9d13-9ecdc7822ca9 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:55.084148 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-2aaac002-8fec-4988-9d13-9ecdc7822ca9 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:55.091887 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-2aaac002-8fec-4988-9d13-9ecdc7822ca9 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1267 microversion: 2.1 time: 0.152074 Aug 24 11:49:55.092441 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 644/1304] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:54 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:56.112674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a63b9cce-5dce-4bda-bd8e-788b9e74fc2a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:56.113229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a63b9cce-5dce-4bda-bd8e-788b9e74fc2a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:56.120169 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a63b9cce-5dce-4bda-bd8e-788b9e74fc2a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:56.120693 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a63b9cce-5dce-4bda-bd8e-788b9e74fc2a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:56.121129 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a63b9cce-5dce-4bda-bd8e-788b9e74fc2a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:56.121820 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a63b9cce-5dce-4bda-bd8e-788b9e74fc2a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:56.122298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a63b9cce-5dce-4bda-bd8e-788b9e74fc2a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:56.122724 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a63b9cce-5dce-4bda-bd8e-788b9e74fc2a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:56.253285 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a63b9cce-5dce-4bda-bd8e-788b9e74fc2a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:56.261262 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a63b9cce-5dce-4bda-bd8e-788b9e74fc2a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1267 microversion: 2.1 time: 0.152554 Aug 24 11:49:56.261834 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 661/1305] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:56 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:57.280857 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-fe426648-63b5-4f6d-a657-ab1d60fb5f1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:57.281443 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-fe426648-63b5-4f6d-a657-ab1d60fb5f1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:57.283890 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell0:SELECT=4 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:57.288935 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fe426648-63b5-4f6d-a657-ab1d60fb5f1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:57.289463 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fe426648-63b5-4f6d-a657-ab1d60fb5f1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:57.289935 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fe426648-63b5-4f6d-a657-ab1d60fb5f1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:57.290646 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fe426648-63b5-4f6d-a657-ab1d60fb5f1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:57.291279 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fe426648-63b5-4f6d-a657-ab1d60fb5f1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:57.291634 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fe426648-63b5-4f6d-a657-ab1d60fb5f1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:57.429216 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-fe426648-63b5-4f6d-a657-ab1d60fb5f1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:57.437358 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-fe426648-63b5-4f6d-a657-ab1d60fb5f1d tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1267 microversion: 2.1 time: 0.160390 Aug 24 11:49:57.437971 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 645/1306] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:57 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:58.457659 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a6bc3a69-664d-4a2a-8a35-fc502df820d3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:58.458298 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a6bc3a69-664d-4a2a-8a35-fc502df820d3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:58.461207 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=10 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:49:58.466653 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6bc3a69-664d-4a2a-8a35-fc502df820d3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:58.467133 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6bc3a69-664d-4a2a-8a35-fc502df820d3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:58.469291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6bc3a69-664d-4a2a-8a35-fc502df820d3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:58.469291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6bc3a69-664d-4a2a-8a35-fc502df820d3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:58.469291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6bc3a69-664d-4a2a-8a35-fc502df820d3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:58.469291 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6bc3a69-664d-4a2a-8a35-fc502df820d3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:58.603474 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a6bc3a69-664d-4a2a-8a35-fc502df820d3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:58.612449 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a6bc3a69-664d-4a2a-8a35-fc502df820d3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1267 microversion: 2.1 time: 0.158616 Aug 24 11:49:58.613020 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 662/1307] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:58 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:49:59.383998 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:49:59.384535 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Wed Aug 24 11:49:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:49:59.632731 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-63e4372b-cdd8-4030-a7c7-87813ca83d49 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:49:59.633261 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-63e4372b-cdd8-4030-a7c7-87813ca83d49 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:49:59.639718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-63e4372b-cdd8-4030-a7c7-87813ca83d49 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:59.640204 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-63e4372b-cdd8-4030-a7c7-87813ca83d49 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:59.640640 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-63e4372b-cdd8-4030-a7c7-87813ca83d49 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:59.641332 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-63e4372b-cdd8-4030-a7c7-87813ca83d49 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:49:59.641784 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-63e4372b-cdd8-4030-a7c7-87813ca83d49 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:49:59.642246 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-63e4372b-cdd8-4030-a7c7-87813ca83d49 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:49:59.771720 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-63e4372b-cdd8-4030-a7c7-87813ca83d49 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:49:59.779491 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-63e4372b-cdd8-4030-a7c7-87813ca83d49 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1267 microversion: 2.1 time: 0.150811 Aug 24 11:49:59.780057 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 646/1308] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:49:59 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:50:00.800612 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-665cf6fe-de9e-4f57-970a-6f736172bd1c tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:50:00.801248 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-665cf6fe-de9e-4f57-970a-6f736172bd1c tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:50:00.808522 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-665cf6fe-de9e-4f57-970a-6f736172bd1c tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:00.809002 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-665cf6fe-de9e-4f57-970a-6f736172bd1c tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:00.809433 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-665cf6fe-de9e-4f57-970a-6f736172bd1c tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:00.810146 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-665cf6fe-de9e-4f57-970a-6f736172bd1c tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:00.810601 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-665cf6fe-de9e-4f57-970a-6f736172bd1c tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:00.811017 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-665cf6fe-de9e-4f57-970a-6f736172bd1c tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:00.938688 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-665cf6fe-de9e-4f57-970a-6f736172bd1c tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:50:00.946781 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-665cf6fe-de9e-4f57-970a-6f736172bd1c tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1267 microversion: 2.1 time: 0.150045 Aug 24 11:50:00.947343 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 663/1309] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:50:00 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:50:01.967257 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-656387bc-1f13-479f-887b-d9f95fe4f11b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:50:01.968001 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-656387bc-1f13-479f-887b-d9f95fe4f11b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:50:01.974878 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-656387bc-1f13-479f-887b-d9f95fe4f11b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:01.992323 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-656387bc-1f13-479f-887b-d9f95fe4f11b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:01.992323 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-656387bc-1f13-479f-887b-d9f95fe4f11b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:01.992323 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-656387bc-1f13-479f-887b-d9f95fe4f11b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:01.992323 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-656387bc-1f13-479f-887b-d9f95fe4f11b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:01.992760 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-656387bc-1f13-479f-887b-d9f95fe4f11b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:02.119190 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-656387bc-1f13-479f-887b-d9f95fe4f11b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:50:02.127214 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-656387bc-1f13-479f-887b-d9f95fe4f11b tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1267 microversion: 2.1 time: 0.163846 Aug 24 11:50:02.127784 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 647/1310] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:50:01 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:50:03.148858 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d2636d20-b8e5-4a19-acd1-65ff79c0890a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:50:03.149498 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d2636d20-b8e5-4a19-acd1-65ff79c0890a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:50:03.155981 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2636d20-b8e5-4a19-acd1-65ff79c0890a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:03.156458 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2636d20-b8e5-4a19-acd1-65ff79c0890a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:03.156889 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2636d20-b8e5-4a19-acd1-65ff79c0890a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:03.157574 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2636d20-b8e5-4a19-acd1-65ff79c0890a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:03.158054 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2636d20-b8e5-4a19-acd1-65ff79c0890a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:03.158474 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2636d20-b8e5-4a19-acd1-65ff79c0890a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:03.289461 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d2636d20-b8e5-4a19-acd1-65ff79c0890a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:50:03.297319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d2636d20-b8e5-4a19-acd1-65ff79c0890a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1267 microversion: 2.1 time: 0.152929 Aug 24 11:50:03.297901 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 664/1311] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:50:03 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:50:04.095088 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-2f37aa72-ab91-47a4-bfa4-421fbeddc255 req-a836b4b6-eb33-49ff-8045-a48c241cbe17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26cb2c70-45e6-4578-8370-7da09c6acb86", "name": "network-vif-plugged", "status": "completed", "tag": "889630d5-cb13-47d3-b0e3-1b043412adb6"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:50:04.105023 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-2f37aa72-ab91-47a4-bfa4-421fbeddc255 req-a836b4b6-eb33-49ff-8045-a48c241cbe17 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:04.105495 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-2f37aa72-ab91-47a4-bfa4-421fbeddc255 req-a836b4b6-eb33-49ff-8045-a48c241cbe17 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:04.105936 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-2f37aa72-ab91-47a4-bfa4-421fbeddc255 req-a836b4b6-eb33-49ff-8045-a48c241cbe17 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:04.116767 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-2f37aa72-ab91-47a4-bfa4-421fbeddc255 req-a836b4b6-eb33-49ff-8045-a48c241cbe17 service nova] Creating event network-vif-plugged:889630d5-cb13-47d3-b0e3-1b043412adb6 for instance 26cb2c70-45e6-4578-8370-7da09c6acb86 on hv-cinder-85427 Aug 24 11:50:04.121799 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-2f37aa72-ab91-47a4-bfa4-421fbeddc255 req-a836b4b6-eb33-49ff-8045-a48c241cbe17 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080372 Aug 24 11:50:04.122417 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 648/1312] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:50:04.318426 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3d4469fe-1cc9-4904-88b4-55dcd93a0a58 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:50:04.318981 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3d4469fe-1cc9-4904-88b4-55dcd93a0a58 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:50:04.325612 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3d4469fe-1cc9-4904-88b4-55dcd93a0a58 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:04.328737 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3d4469fe-1cc9-4904-88b4-55dcd93a0a58 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:04.328737 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3d4469fe-1cc9-4904-88b4-55dcd93a0a58 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:04.328737 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3d4469fe-1cc9-4904-88b4-55dcd93a0a58 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:04.328737 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3d4469fe-1cc9-4904-88b4-55dcd93a0a58 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:04.329723 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3d4469fe-1cc9-4904-88b4-55dcd93a0a58 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:04.465245 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3d4469fe-1cc9-4904-88b4-55dcd93a0a58 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:50:04.473180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3d4469fe-1cc9-4904-88b4-55dcd93a0a58 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1267 microversion: 2.1 time: 0.158663 Aug 24 11:50:04.473736 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 665/1313] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:50:04 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:50:05.495472 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-18a13b34-b25f-4e89-9326-11d8eb632e38 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:50:05.496214 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-18a13b34-b25f-4e89-9326-11d8eb632e38 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:50:05.502426 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-18a13b34-b25f-4e89-9326-11d8eb632e38 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:05.502898 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-18a13b34-b25f-4e89-9326-11d8eb632e38 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:05.503323 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-18a13b34-b25f-4e89-9326-11d8eb632e38 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:05.504001 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-18a13b34-b25f-4e89-9326-11d8eb632e38 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:05.504443 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-18a13b34-b25f-4e89-9326-11d8eb632e38 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:05.504856 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-18a13b34-b25f-4e89-9326-11d8eb632e38 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:05.639934 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-18a13b34-b25f-4e89-9326-11d8eb632e38 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:50:05.648203 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-18a13b34-b25f-4e89-9326-11d8eb632e38 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1267 microversion: 2.1 time: 0.158412 Aug 24 11:50:05.648773 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 649/1314] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:50:05 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:50:06.669259 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cf5ef6d9-31ac-4cd1-81ad-ccb69d75293a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:50:06.669861 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cf5ef6d9-31ac-4cd1-81ad-ccb69d75293a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:50:06.676751 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf5ef6d9-31ac-4cd1-81ad-ccb69d75293a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:06.677224 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf5ef6d9-31ac-4cd1-81ad-ccb69d75293a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:06.677656 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf5ef6d9-31ac-4cd1-81ad-ccb69d75293a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:06.679013 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf5ef6d9-31ac-4cd1-81ad-ccb69d75293a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:06.679663 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf5ef6d9-31ac-4cd1-81ad-ccb69d75293a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:06.680211 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cf5ef6d9-31ac-4cd1-81ad-ccb69d75293a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:06.813842 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cf5ef6d9-31ac-4cd1-81ad-ccb69d75293a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:50:06.821644 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cf5ef6d9-31ac-4cd1-81ad-ccb69d75293a tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1454 microversion: 2.1 time: 0.156336 Aug 24 11:50:06.822239 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 666/1315] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:50:06 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:50:06.840913 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-fb46b17b-115c-4830-8547-e0f2dd6e4a92 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:50:06.841524 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-fb46b17b-115c-4830-8547-e0f2dd6e4a92 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:50:06.848072 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fb46b17b-115c-4830-8547-e0f2dd6e4a92 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:06.848499 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fb46b17b-115c-4830-8547-e0f2dd6e4a92 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:06.848946 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fb46b17b-115c-4830-8547-e0f2dd6e4a92 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:06.849627 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fb46b17b-115c-4830-8547-e0f2dd6e4a92 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:06.850676 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fb46b17b-115c-4830-8547-e0f2dd6e4a92 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:06.851098 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-fb46b17b-115c-4830-8547-e0f2dd6e4a92 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:06.984925 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-fb46b17b-115c-4830-8547-e0f2dd6e4a92 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:50:06.993708 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-fb46b17b-115c-4830-8547-e0f2dd6e4a92 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1454 microversion: 2.1 time: 0.156559 Aug 24 11:50:06.994335 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 650/1316] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:50:06 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:50:09.186769 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-95ea714d-4355-49ed-8f52-d12196cb2e46 req-06ff248b-20c3-4043-92f1-839772e6725c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cb2c70-45e6-4578-8370-7da09c6acb86", "tag": "889630d5-cb13-47d3-b0e3-1b043412adb6"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:50:09.200494 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-95ea714d-4355-49ed-8f52-d12196cb2e46 req-06ff248b-20c3-4043-92f1-839772e6725c service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:50:09.200982 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-95ea714d-4355-49ed-8f52-d12196cb2e46 req-06ff248b-20c3-4043-92f1-839772e6725c service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:50:09.201414 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-95ea714d-4355-49ed-8f52-d12196cb2e46 req-06ff248b-20c3-4043-92f1-839772e6725c service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:50:09.213883 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-95ea714d-4355-49ed-8f52-d12196cb2e46 req-06ff248b-20c3-4043-92f1-839772e6725c service nova] Creating event network-changed:889630d5-cb13-47d3-b0e3-1b043412adb6 for instance 26cb2c70-45e6-4578-8370-7da09c6acb86 on hv-cinder-85427 Aug 24 11:50:09.219210 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-95ea714d-4355-49ed-8f52-d12196cb2e46 req-06ff248b-20c3-4043-92f1-839772e6725c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103932 Aug 24 11:50:09.219970 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 667/1317] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:51:33.482992 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:51:33.483619 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Wed Aug 24 11:51:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:52:03.947976 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_api:SELECT=28 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:03.949093 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG dbcounter [-] [121222] Writing DB stats nova_cell1:SELECT=52 {{(pid=121222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:03.953028 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-dfa8d61f-160c-47ab-a4e1-d23d8beacfc3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:03.953523 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-dfa8d61f-160c-47ab-a4e1-d23d8beacfc3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:03.953943 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-badf26c8-9f6d-4f5c-82d3-e2c7c52bb5d1 req-8e51fff8-3019-4615-92ee-5f6514cb8c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cb2c70-45e6-4578-8370-7da09c6acb86", "tag": "889630d5-cb13-47d3-b0e3-1b043412adb6"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:52:03.959882 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dfa8d61f-160c-47ab-a4e1-d23d8beacfc3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:03.960142 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:03.960368 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dfa8d61f-160c-47ab-a4e1-d23d8beacfc3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:03.960801 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dfa8d61f-160c-47ab-a4e1-d23d8beacfc3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:03.961412 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=58 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 11:52:03.961955 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dfa8d61f-160c-47ab-a4e1-d23d8beacfc3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:03.962549 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dfa8d61f-160c-47ab-a4e1-d23d8beacfc3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:03.962975 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dfa8d61f-160c-47ab-a4e1-d23d8beacfc3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:03.968215 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-badf26c8-9f6d-4f5c-82d3-e2c7c52bb5d1 req-8e51fff8-3019-4615-92ee-5f6514cb8c47 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:03.968704 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-badf26c8-9f6d-4f5c-82d3-e2c7c52bb5d1 req-8e51fff8-3019-4615-92ee-5f6514cb8c47 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:03.969132 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-badf26c8-9f6d-4f5c-82d3-e2c7c52bb5d1 req-8e51fff8-3019-4615-92ee-5f6514cb8c47 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:03.983016 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-badf26c8-9f6d-4f5c-82d3-e2c7c52bb5d1 req-8e51fff8-3019-4615-92ee-5f6514cb8c47 service nova] Creating event network-changed:889630d5-cb13-47d3-b0e3-1b043412adb6 for instance 26cb2c70-45e6-4578-8370-7da09c6acb86 on hv-cinder-85427 Aug 24 11:52:03.989252 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-badf26c8-9f6d-4f5c-82d3-e2c7c52bb5d1 req-8e51fff8-3019-4615-92ee-5f6514cb8c47 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040856 Aug 24 11:52:03.989616 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-dfa8d61f-160c-47ab-a4e1-d23d8beacfc3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Going to try to terminate instance {{(pid=121222) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:52:03.990155 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 668/1318] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:52:04.315380 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-dfa8d61f-160c-47ab-a4e1-d23d8beacfc3 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 204 len: 0 microversion: 2.1 time: 0.370009 Aug 24 11:52:04.319122 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 651/1319] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:52:03 2022] DELETE /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:52:04.325400 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fc9e635c-07f3-42bb-ac7d-240444d9f692 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:04.326137 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fc9e635c-07f3-42bb-ac7d-240444d9f692 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:04.334672 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc9e635c-07f3-42bb-ac7d-240444d9f692 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:04.335453 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc9e635c-07f3-42bb-ac7d-240444d9f692 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:04.335706 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc9e635c-07f3-42bb-ac7d-240444d9f692 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:04.336448 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc9e635c-07f3-42bb-ac7d-240444d9f692 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:04.336898 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc9e635c-07f3-42bb-ac7d-240444d9f692 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:04.337319 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc9e635c-07f3-42bb-ac7d-240444d9f692 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:04.474061 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fc9e635c-07f3-42bb-ac7d-240444d9f692 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:52:04.482325 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fc9e635c-07f3-42bb-ac7d-240444d9f692 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1579 microversion: 2.1 time: 0.161539 Aug 24 11:52:04.482912 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 669/1320] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:04 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:52:05.505071 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-dd67ab76-fe1d-43e3-8448-4678fc4d08bf tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:05.505807 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-dd67ab76-fe1d-43e3-8448-4678fc4d08bf tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:05.512435 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dd67ab76-fe1d-43e3-8448-4678fc4d08bf tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:05.515709 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dd67ab76-fe1d-43e3-8448-4678fc4d08bf tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:05.515709 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dd67ab76-fe1d-43e3-8448-4678fc4d08bf tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:05.515709 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dd67ab76-fe1d-43e3-8448-4678fc4d08bf tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:05.515709 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dd67ab76-fe1d-43e3-8448-4678fc4d08bf tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:05.516093 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-dd67ab76-fe1d-43e3-8448-4678fc4d08bf tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:05.650159 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-dd67ab76-fe1d-43e3-8448-4678fc4d08bf tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:52:05.658126 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-dd67ab76-fe1d-43e3-8448-4678fc4d08bf tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1579 microversion: 2.1 time: 0.157224 Aug 24 11:52:05.658681 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 652/1321] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:05 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:52:06.679664 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7599fbbe-1e04-4a2e-8805-7293cd56ce2e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:06.680784 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7599fbbe-1e04-4a2e-8805-7293cd56ce2e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:06.687531 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7599fbbe-1e04-4a2e-8805-7293cd56ce2e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:06.688023 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7599fbbe-1e04-4a2e-8805-7293cd56ce2e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:06.688468 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7599fbbe-1e04-4a2e-8805-7293cd56ce2e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:06.689176 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7599fbbe-1e04-4a2e-8805-7293cd56ce2e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:06.689631 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7599fbbe-1e04-4a2e-8805-7293cd56ce2e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:06.690090 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7599fbbe-1e04-4a2e-8805-7293cd56ce2e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:06.857674 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7599fbbe-1e04-4a2e-8805-7293cd56ce2e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:52:06.867078 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7599fbbe-1e04-4a2e-8805-7293cd56ce2e tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1460 microversion: 2.1 time: 0.191311 Aug 24 11:52:06.868579 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 670/1322] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:06 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1460 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:52:06.913438 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-5c5d2eb1-6a93-4c0d-80e1-4d408aa7bd5c req-4edc90ef-7781-425a-b8d4-0df030f6e16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26cb2c70-45e6-4578-8370-7da09c6acb86", "name": "network-vif-deleted", "tag": "889630d5-cb13-47d3-b0e3-1b043412adb6"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:52:06.923970 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-5c5d2eb1-6a93-4c0d-80e1-4d408aa7bd5c req-4edc90ef-7781-425a-b8d4-0df030f6e16b service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:06.924968 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-5c5d2eb1-6a93-4c0d-80e1-4d408aa7bd5c req-4edc90ef-7781-425a-b8d4-0df030f6e16b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:06.924968 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-5c5d2eb1-6a93-4c0d-80e1-4d408aa7bd5c req-4edc90ef-7781-425a-b8d4-0df030f6e16b service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:06.935962 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-5c5d2eb1-6a93-4c0d-80e1-4d408aa7bd5c req-4edc90ef-7781-425a-b8d4-0df030f6e16b service nova] Creating event network-vif-deleted:889630d5-cb13-47d3-b0e3-1b043412adb6 for instance 26cb2c70-45e6-4578-8370-7da09c6acb86 on hv-cinder-85427 Aug 24 11:52:06.940938 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-5c5d2eb1-6a93-4c0d-80e1-4d408aa7bd5c req-4edc90ef-7781-425a-b8d4-0df030f6e16b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031822 Aug 24 11:52:06.941771 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 653/1323] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:52:07.890311 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4033cf39-5bdc-4a5c-b231-f030ab1503d8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:07.890858 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4033cf39-5bdc-4a5c-b231-f030ab1503d8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:07.897180 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4033cf39-5bdc-4a5c-b231-f030ab1503d8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:07.897657 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4033cf39-5bdc-4a5c-b231-f030ab1503d8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:07.898125 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4033cf39-5bdc-4a5c-b231-f030ab1503d8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:07.898811 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4033cf39-5bdc-4a5c-b231-f030ab1503d8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:07.899266 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4033cf39-5bdc-4a5c-b231-f030ab1503d8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:07.899688 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4033cf39-5bdc-4a5c-b231-f030ab1503d8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:07.930199 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4033cf39-5bdc-4a5c-b231-f030ab1503d8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:07.930681 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4033cf39-5bdc-4a5c-b231-f030ab1503d8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:07.931111 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4033cf39-5bdc-4a5c-b231-f030ab1503d8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:07.931549 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-4033cf39-5bdc-4a5c-b231-f030ab1503d8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lazy-loading 'fault' on Instance uuid 26cb2c70-45e6-4578-8370-7da09c6acb86 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:52:07.974757 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4033cf39-5bdc-4a5c-b231-f030ab1503d8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:52:07.982391 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4033cf39-5bdc-4a5c-b231-f030ab1503d8 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 200 len: 1231 microversion: 2.1 time: 0.096104 Aug 24 11:52:07.982956 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 671/1324] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:07 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:52:09.004694 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-81d4ad82-b212-4e5c-b314-e50587b718fa tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:09.006078 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-81d4ad82-b212-4e5c-b314-e50587b718fa tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 26cb2c70-45e6-4578-8370-7da09c6acb86] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:09.013538 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-81d4ad82-b212-4e5c-b314-e50587b718fa tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:09.014067 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-81d4ad82-b212-4e5c-b314-e50587b718fa tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:09.014503 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-81d4ad82-b212-4e5c-b314-e50587b718fa tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:09.015262 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-81d4ad82-b212-4e5c-b314-e50587b718fa tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:09.015833 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-81d4ad82-b212-4e5c-b314-e50587b718fa tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:09.016260 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-81d4ad82-b212-4e5c-b314-e50587b718fa tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:09.031666 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-81d4ad82-b212-4e5c-b314-e50587b718fa tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] HTTP exception thrown: Instance 26cb2c70-45e6-4578-8370-7da09c6acb86 could not be found. Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-81d4ad82-b212-4e5c-b314-e50587b718fa tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Request method failure captured: Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 HTTP/1.1 Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBg77MddKHUs2sTldK6Ry6JYMfyI49tEDKc3Iakf4He2S5HEScp72I7e8uUiRUNAlnllVWpcHsEcwDG5GZUdAcgj-3t7HTK4NM7dIwN5OrdMec2RAtv-Xgz0Hv6ObhyWiu6aVlJNJgMjlx6aF25_mHTx8Zns42si6uF5-oPECnDq8djg Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 548b5e4f59b24f0a9b88bf125c8a19a8 Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:52:09.033580 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:52:09.035303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_548b5e4f59b24f0a9b88bf125c8a19a8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:52:09.035303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:52:09.035303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 548b5e4f59b24f0a9b88bf125c8a19a8 Aug 24 11:52:09.035303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:52:09.035303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-TestVolumeBootPattern-1426993665-project Aug 24 11:52:09.035303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:52:09.035303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:52:09.035303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 4edfa99b10014e8289697a255d8b90cf Aug 24 11:52:09.035303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-TestVolumeBootPattern-1426993665-project Aug 24 11:52:09.035303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:52:09.035303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance 26cb2c70-45e6-4578-8370-7da09c6acb86 could not be found. Aug 24 11:52:09.035303 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': '26cb2c70-45e6-4578-8370-7da09c6acb86'} Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26cb2c70-45e6-4578-8370-7da09c6acb86 could not be found. Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:52:09.036239 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26cb2c70-45e6-4578-8370-7da09c6acb86 could not be found. Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26cb2c70-45e6-4578-8370-7da09c6acb86 could not be found. Aug 24 11:52:09.037739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:52:09.039110 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-81d4ad82-b212-4e5c-b314-e50587b718fa tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Returning 404 to user: Instance 26cb2c70-45e6-4578-8370-7da09c6acb86 could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:52:09.039110 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-81d4ad82-b212-4e5c-b314-e50587b718fa tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86" status: 404 len: 111 microversion: 2.1 time: 0.035242 Aug 24 11:52:09.039110 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 654/1325] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:08 2022] GET /compute/v2.1/servers/26cb2c70-45e6-4578-8370-7da09c6acb86 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:52:12.655836 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2c02e68e-afcc-4576-a2c8-c81f298657a7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:12.656461 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2c02e68e-afcc-4576-a2c8-c81f298657a7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:12.658259 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [req-fbf6f839-0b0e-4044-b726-f5072c691c50 req-0d2cc7f4-0fa1-4a29-be05-79b0eb08734f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "021bccdc-e3c1-4152-a08a-486eca7a7993", "tag": "a5612f11-8f9a-48ae-bb0f-1486a455d7e2"}]} {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:52:12.663094 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c02e68e-afcc-4576-a2c8-c81f298657a7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:12.663610 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c02e68e-afcc-4576-a2c8-c81f298657a7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:12.664050 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c02e68e-afcc-4576-a2c8-c81f298657a7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:12.664747 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c02e68e-afcc-4576-a2c8-c81f298657a7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:12.665201 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c02e68e-afcc-4576-a2c8-c81f298657a7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:12.665626 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c02e68e-afcc-4576-a2c8-c81f298657a7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:12.673525 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fbf6f839-0b0e-4044-b726-f5072c691c50 req-0d2cc7f4-0fa1-4a29-be05-79b0eb08734f service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:12.674273 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fbf6f839-0b0e-4044-b726-f5072c691c50 req-0d2cc7f4-0fa1-4a29-be05-79b0eb08734f service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:12.674902 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [req-fbf6f839-0b0e-4044-b726-f5072c691c50 req-0d2cc7f4-0fa1-4a29-be05-79b0eb08734f service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:12.687971 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.compute.server_external_events [req-fbf6f839-0b0e-4044-b726-f5072c691c50 req-0d2cc7f4-0fa1-4a29-be05-79b0eb08734f service nova] Creating event network-changed:a5612f11-8f9a-48ae-bb0f-1486a455d7e2 for instance 021bccdc-e3c1-4152-a08a-486eca7a7993 on hv-cinder-85427 Aug 24 11:52:12.692000 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2c02e68e-afcc-4576-a2c8-c81f298657a7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 11:52:12.693824 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [req-fbf6f839-0b0e-4044-b726-f5072c691c50 req-0d2cc7f4-0fa1-4a29-be05-79b0eb08734f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039367 Aug 24 11:52:12.695615 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 655/1326] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 11:52:12.964254 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2c02e68e-afcc-4576-a2c8-c81f298657a7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 204 len: 0 microversion: 2.1 time: 0.312576 Aug 24 11:52:12.965042 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 672/1327] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:52:12 2022] DELETE /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 11:52:12.973553 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-8c70a27e-f7f6-4160-8cd3-4fd43c43b1ca tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:12.974297 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-8c70a27e-f7f6-4160-8cd3-4fd43c43b1ca tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:12.981398 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8c70a27e-f7f6-4160-8cd3-4fd43c43b1ca tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:12.982155 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8c70a27e-f7f6-4160-8cd3-4fd43c43b1ca tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:12.982595 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8c70a27e-f7f6-4160-8cd3-4fd43c43b1ca tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:12.983294 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8c70a27e-f7f6-4160-8cd3-4fd43c43b1ca tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:12.984133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8c70a27e-f7f6-4160-8cd3-4fd43c43b1ca tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:12.984720 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-8c70a27e-f7f6-4160-8cd3-4fd43c43b1ca tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:13.170582 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-8c70a27e-f7f6-4160-8cd3-4fd43c43b1ca tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:52:13.180260 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-8c70a27e-f7f6-4160-8cd3-4fd43c43b1ca tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1578 microversion: 2.1 time: 0.210227 Aug 24 11:52:13.180861 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 656/1328] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:12 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1578 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:52:14.202385 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-874478b3-3982-4d09-9b40-c89c98825910 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:14.203093 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-874478b3-3982-4d09-9b40-c89c98825910 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:14.209229 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-874478b3-3982-4d09-9b40-c89c98825910 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:14.209703 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-874478b3-3982-4d09-9b40-c89c98825910 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:14.210164 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-874478b3-3982-4d09-9b40-c89c98825910 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:14.211417 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-874478b3-3982-4d09-9b40-c89c98825910 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:14.211865 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-874478b3-3982-4d09-9b40-c89c98825910 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:14.212280 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-874478b3-3982-4d09-9b40-c89c98825910 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:14.461152 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-874478b3-3982-4d09-9b40-c89c98825910 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:52:14.469765 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-874478b3-3982-4d09-9b40-c89c98825910 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1578 microversion: 2.1 time: 0.271879 Aug 24 11:52:14.470376 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 673/1329] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:14 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1578 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:52:15.490755 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-60872b77-4532-4a85-8963-a7e60d4293b7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:15.492294 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-60872b77-4532-4a85-8963-a7e60d4293b7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:15.500731 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-60872b77-4532-4a85-8963-a7e60d4293b7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:15.501282 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-60872b77-4532-4a85-8963-a7e60d4293b7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:15.501718 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-60872b77-4532-4a85-8963-a7e60d4293b7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:15.502459 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-60872b77-4532-4a85-8963-a7e60d4293b7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:15.502964 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-60872b77-4532-4a85-8963-a7e60d4293b7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:15.503360 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-60872b77-4532-4a85-8963-a7e60d4293b7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:15.651610 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-60872b77-4532-4a85-8963-a7e60d4293b7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:52:15.655420 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-60872b77-4532-4a85-8963-a7e60d4293b7 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1459 microversion: 2.1 time: 0.169176 Aug 24 11:52:15.656085 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 657/1330] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:15 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1459 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:52:15.860248 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-da94d8ba-afab-4084-8d71-a9fd7525a1e5 req-ca0f01bb-14b3-4aa8-a5a7-0d88b2a5b3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021bccdc-e3c1-4152-a08a-486eca7a7993", "name": "network-vif-deleted", "tag": "a5612f11-8f9a-48ae-bb0f-1486a455d7e2"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 11:52:15.870738 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-da94d8ba-afab-4084-8d71-a9fd7525a1e5 req-ca0f01bb-14b3-4aa8-a5a7-0d88b2a5b3d2 service nova] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:15.871212 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-da94d8ba-afab-4084-8d71-a9fd7525a1e5 req-ca0f01bb-14b3-4aa8-a5a7-0d88b2a5b3d2 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:15.871644 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-da94d8ba-afab-4084-8d71-a9fd7525a1e5 req-ca0f01bb-14b3-4aa8-a5a7-0d88b2a5b3d2 service nova] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:15.883145 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-da94d8ba-afab-4084-8d71-a9fd7525a1e5 req-ca0f01bb-14b3-4aa8-a5a7-0d88b2a5b3d2 service nova] Creating event network-vif-deleted:a5612f11-8f9a-48ae-bb0f-1486a455d7e2 for instance 021bccdc-e3c1-4152-a08a-486eca7a7993 on hv-cinder-85427 Aug 24 11:52:15.888214 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-da94d8ba-afab-4084-8d71-a9fd7525a1e5 req-ca0f01bb-14b3-4aa8-a5a7-0d88b2a5b3d2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031646 Aug 24 11:52:15.888813 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 674/1331] 10.222.0.83 () {64 vars in 1317 bytes} [Wed Aug 24 11:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 11:52:16.677070 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-5264e409-155c-4b41-9f0d-79c1c621e0cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:16.677719 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-5264e409-155c-4b41-9f0d-79c1c621e0cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:16.684811 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5264e409-155c-4b41-9f0d-79c1c621e0cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:16.685301 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5264e409-155c-4b41-9f0d-79c1c621e0cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:16.685739 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5264e409-155c-4b41-9f0d-79c1c621e0cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:16.686464 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5264e409-155c-4b41-9f0d-79c1c621e0cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:16.686916 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5264e409-155c-4b41-9f0d-79c1c621e0cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:16.687342 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5264e409-155c-4b41-9f0d-79c1c621e0cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:16.718223 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5264e409-155c-4b41-9f0d-79c1c621e0cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:16.718706 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5264e409-155c-4b41-9f0d-79c1c621e0cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:16.719142 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-5264e409-155c-4b41-9f0d-79c1c621e0cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:16.719948 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.objects.instance [None req-5264e409-155c-4b41-9f0d-79c1c621e0cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lazy-loading 'fault' on Instance uuid 021bccdc-e3c1-4152-a08a-486eca7a7993 {{(pid=121222) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 11:52:16.761019 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.policy [None req-5264e409-155c-4b41-9f0d-79c1c621e0cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4edfa99b10014e8289697a255d8b90cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548b5e4f59b24f0a9b88bf125c8a19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121222) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 11:52:16.768846 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-5264e409-155c-4b41-9f0d-79c1c621e0cc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 200 len: 1230 microversion: 2.1 time: 0.095723 Aug 24 11:52:16.769420 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 658/1332] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:16 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 11:52:17.790543 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1c262c77-5160-4174-9218-616d5e2e34ad tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:17.791255 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1c262c77-5160-4174-9218-616d5e2e34ad tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: 021bccdc-e3c1-4152-a08a-486eca7a7993] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:17.797929 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c262c77-5160-4174-9218-616d5e2e34ad tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:17.798417 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c262c77-5160-4174-9218-616d5e2e34ad tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:17.798853 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c262c77-5160-4174-9218-616d5e2e34ad tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:17.799547 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c262c77-5160-4174-9218-616d5e2e34ad tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:17.800004 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c262c77-5160-4174-9218-616d5e2e34ad tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:17.800437 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c262c77-5160-4174-9218-616d5e2e34ad tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:17.815801 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-1c262c77-5160-4174-9218-616d5e2e34ad tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] HTTP exception thrown: Instance 021bccdc-e3c1-4152-a08a-486eca7a7993 could not be found. Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1c262c77-5160-4174-9218-616d5e2e34ad tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Request method failure captured: Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 HTTP/1.1 Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBg77MddKHUs2sTldK6Ry6JYMfyI49tEDKc3Iakf4He2S5HEScp72I7e8uUiRUNAlnllVWpcHsEcwDG5GZUdAcgj-3t7HTK4NM7dIwN5OrdMec2RAtv-Xgz0Hv6ObhyWiu6aVlJNJgMjlx6aF25_mHTx8Zns42si6uF5-oPECnDq8djg Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 548b5e4f59b24f0a9b88bf125c8a19a8 Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:52:17.817434 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:52:17.819118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_548b5e4f59b24f0a9b88bf125c8a19a8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:52:17.819118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:52:17.819118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 548b5e4f59b24f0a9b88bf125c8a19a8 Aug 24 11:52:17.819118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:52:17.819118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-TestVolumeBootPattern-1426993665-project Aug 24 11:52:17.819118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:52:17.819118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:52:17.819118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 4edfa99b10014e8289697a255d8b90cf Aug 24 11:52:17.819118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-TestVolumeBootPattern-1426993665-project Aug 24 11:52:17.819118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:52:17.819118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance 021bccdc-e3c1-4152-a08a-486eca7a7993 could not be found. Aug 24 11:52:17.819118 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': '021bccdc-e3c1-4152-a08a-486eca7a7993'} Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021bccdc-e3c1-4152-a08a-486eca7a7993 could not be found. Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:52:17.820518 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021bccdc-e3c1-4152-a08a-486eca7a7993 could not be found. Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021bccdc-e3c1-4152-a08a-486eca7a7993 could not be found. Aug 24 11:52:17.822235 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:52:17.824108 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1c262c77-5160-4174-9218-616d5e2e34ad tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Returning 404 to user: Instance 021bccdc-e3c1-4152-a08a-486eca7a7993 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:52:17.824108 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1c262c77-5160-4174-9218-616d5e2e34ad tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993" status: 404 len: 111 microversion: 2.1 time: 0.032640 Aug 24 11:52:17.824108 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 675/1333] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:17 2022] GET /compute/v2.1/servers/021bccdc-e3c1-4152-a08a-486eca7a7993 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:52:18.354730 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b8a35b2e-49fc-4387-bf7f-5a941f5154bc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:18.355273 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.compute.api [None req-b8a35b2e-49fc-4387-bf7f-5a941f5154bc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121222) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:18.361754 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b8a35b2e-49fc-4387-bf7f-5a941f5154bc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:18.362529 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b8a35b2e-49fc-4387-bf7f-5a941f5154bc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:18.362993 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b8a35b2e-49fc-4387-bf7f-5a941f5154bc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:18.363878 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b8a35b2e-49fc-4387-bf7f-5a941f5154bc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:18.364417 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b8a35b2e-49fc-4387-bf7f-5a941f5154bc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:18.364816 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG oslo_concurrency.lockutils [None req-b8a35b2e-49fc-4387-bf7f-5a941f5154bc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:18.378152 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.wsgi [None req-b8a35b2e-49fc-4387-bf7f-5a941f5154bc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] HTTP exception thrown: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b8a35b2e-49fc-4387-bf7f-5a941f5154bc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Request method failure captured: Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: request: DELETE /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee HTTP/1.1 Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept: application/json Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Accept-Encoding: identity Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Connection: close Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Length: 0 Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Content-Type: application/json Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Host: 10.222.0.83 Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Openstack-System-Scope: None Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: User-Agent: python-urllib3/1.26.11 Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Auth-Token: gAAAAABjBg77MddKHUs2sTldK6Ry6JYMfyI49tEDKc3Iakf4He2S5HEScp72I7e8uUiRUNAlnllVWpcHsEcwDG5GZUdAcgj-3t7HTK4NM7dIwN5OrdMec2RAtv-Xgz0Hv6ObhyWiu6aVlJNJgMjlx6aF25_mHTx8Zns42si6uF5-oPECnDq8djg Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Id: None Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Domain-Name: None Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Identity-Status: Confirmed Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Is-Admin-Project: True Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Id: default Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Domain-Name: Default Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Id: 548b5e4f59b24f0a9b88bf125c8a19a8 Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Project-Name: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Role: member,reader Aug 24 11:52:18.379827 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Roles: member,reader Aug 24 11:52:18.382842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_548b5e4f59b24f0a9b88bf125c8a19a8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:52:18.382842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:52:18.382842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Id: 548b5e4f59b24f0a9b88bf125c8a19a8 Aug 24 11:52:18.382842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-Tenant-Name: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:52:18.382842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User: tempest-TestVolumeBootPattern-1426993665-project Aug 24 11:52:18.382842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Id: default Aug 24 11:52:18.382842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Domain-Name: Default Aug 24 11:52:18.382842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Id: 4edfa99b10014e8289697a255d8b90cf Aug 24 11:52:18.382842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: X-User-Name: tempest-TestVolumeBootPattern-1426993665-project Aug 24 11:52:18.382842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: method: > Aug 24 11:52:18.382842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: exception: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:52:18.382842 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: action_args: {'id': 'b77d1842-757c-4c5e-9187-54b891e4feee'} Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:52:18.384576 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:52:18.387133 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: ERROR nova.api.openstack.wsgi Aug 24 11:52:18.389487 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-b8a35b2e-49fc-4387-bf7f-5a941f5154bc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Returning 404 to user: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. {{(pid=121222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:52:18.389487 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-b8a35b2e-49fc-4387-bf7f-5a941f5154bc tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 404 len: 111 microversion: 2.1 time: 0.031149 Aug 24 11:52:18.389487 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 659/1334] 10.222.0.83 () {58 vars in 1239 bytes} [Wed Aug 24 11:52:18 2022] DELETE /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:52:18.390045 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5af62254-3649-4b82-85f1-28e40c22804f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:18.390668 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5af62254-3649-4b82-85f1-28e40c22804f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] [instance: b77d1842-757c-4c5e-9187-54b891e4feee] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 11:52:18.396780 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5af62254-3649-4b82-85f1-28e40c22804f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:18.397284 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5af62254-3649-4b82-85f1-28e40c22804f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:18.397728 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5af62254-3649-4b82-85f1-28e40c22804f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:18.398943 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5af62254-3649-4b82-85f1-28e40c22804f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Acquiring lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 11:52:18.399400 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5af62254-3649-4b82-85f1-28e40c22804f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 11:52:18.399822 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5af62254-3649-4b82-85f1-28e40c22804f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Lock "383ae89b-deb9-4b79-b0ab-3281c5f1e615" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 11:52:18.413120 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-5af62254-3649-4b82-85f1-28e40c22804f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] HTTP exception thrown: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5af62254-3649-4b82-85f1-28e40c22804f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Request method failure captured: Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee HTTP/1.1 Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept: application/json Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Connection: close Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Length: 0 Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Content-Type: application/json Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Host: 10.222.0.83 Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.11 Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjBg77MddKHUs2sTldK6Ry6JYMfyI49tEDKc3Iakf4He2S5HEScp72I7e8uUiRUNAlnllVWpcHsEcwDG5GZUdAcgj-3t7HTK4NM7dIwN5OrdMec2RAtv-Xgz0Hv6ObhyWiu6aVlJNJgMjlx6aF25_mHTx8Zns42si6uF5-oPECnDq8djg Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Id: 548b5e4f59b24f0a9b88bf125c8a19a8 Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Role: member,reader Aug 24 11:52:18.415219 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Aug 24 11:52:18.416925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_548b5e4f59b24f0a9b88bf125c8a19a8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/548b5e4f59b24f0a9b88bf125c8a19a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}] Aug 24 11:52:18.416925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:52:18.416925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 548b5e4f59b24f0a9b88bf125c8a19a8 Aug 24 11:52:18.416925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-TestVolumeBootPattern-1426993665 Aug 24 11:52:18.416925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User: tempest-TestVolumeBootPattern-1426993665-project Aug 24 11:52:18.416925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Aug 24 11:52:18.416925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Aug 24 11:52:18.416925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Id: 4edfa99b10014e8289697a255d8b90cf Aug 24 11:52:18.416925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-TestVolumeBootPattern-1426993665-project Aug 24 11:52:18.416925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: method: > Aug 24 11:52:18.416925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: exception: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:52:18.416925 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: action_args: {'id': 'b77d1842-757c-4c5e-9187-54b891e4feee'} Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 11:52:18.417799 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. Aug 24 11:52:18.419481 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Aug 24 11:52:18.420956 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5af62254-3649-4b82-85f1-28e40c22804f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Returning 404 to user: Instance b77d1842-757c-4c5e-9187-54b891e4feee could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 11:52:18.420956 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5af62254-3649-4b82-85f1-28e40c22804f tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee" status: 404 len: 111 microversion: 2.1 time: 0.030539 Aug 24 11:52:18.420956 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 676/1335] 10.222.0.83 () {58 vars in 1236 bytes} [Wed Aug 24 11:52:18 2022] GET /compute/v2.1/servers/b77d1842-757c-4c5e-9187-54b891e4feee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 11:52:20.266630 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: DEBUG nova.api.openstack.wsgi [None req-e876bf83-dee9-4e14-a0c1-882cf65c82f4 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] Calling method '.version_select at 0x7f72420dc940>' {{(pid=121222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 11:52:20.433589 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO nova.api.openstack.requestlog [None req-e876bf83-dee9-4e14-a0c1-882cf65c82f4 tempest-TestVolumeBootPattern-1426993665 tempest-TestVolumeBootPattern-1426993665-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1093131630" status: 202 len: 0 microversion: 2.1 time: 0.170894 Aug 24 11:52:20.434215 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: [pid: 121222|app: 0|req: 660/1336] 10.222.0.83 () {58 vars in 1263 bytes} [Wed Aug 24 11:52:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1093131630 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 11:53:11.541982 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:53:11.542613 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:53:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:53:19.392331 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:53:19.392931 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Wed Aug 24 11:53:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:54:53.491526 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:54:53.492258 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Wed Aug 24 11:54:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:54:55.030791 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:54:55.031402 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:54:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:55:08.272567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:55:08.272567 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Wed Aug 24 11:55:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:55:09.493659 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:55:09.501512 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:55:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:56:31.550646 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:56:31.551474 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:56:39.402693 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:56:39.403268 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Wed Aug 24 11:56:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:58:13.499960 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:58:13.500697 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Wed Aug 24 11:58:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:58:15.040273 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:58:15.040906 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:58:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:58:28.279029 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:58:28.279533 dv-cinder-854273-2-iscsi devstack@n-api.service[121222]: Wed Aug 24 11:58:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 11:58:29.501591 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 11:58:29.502149 dv-cinder-854273-2-iscsi devstack@n-api.service[121221]: Wed Aug 24 11:58:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!